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INTRODUCTION 



Much of the research on instructional games and simulations supports their use in 
many contexts and subject areas (e.g., Bright et al., 1985; Dempsey et al., 1997; Jacobs & 
Dempsey, 1993). Because games and simulations are capable of supporting situated 
learning and anchored instruction, it is reasonable to assume they may be successful in 
promoting transfer. This has not been examined in the literature, nor have any differences 
between the two modes, which are delineated primarily by the presence or absence of 
competition, been explored. 

Research on transfer has also suggested that prompting users to recall and use 
prior knowledge can promote transfer of learning. This has not been examined in the 
instructional simulation and gaming literature to date. Games and simulations often make 
use of built-in help systems or advisors (e.g., Fingar, 1999). It seems reasonable to expect 
that such help systems, or advisors, could be used to prompt learners to recall prior 
knowledge, although this has not been done prior to this study. 

To explore these areas, a computer simulation game was developed that combined 
the elements of competition, advisement, and an authentic environment in which to 
promote transfer. Learners played a character helping to fix up a house for their aunt and 
uncle who are remodeling contractors. Learners had to calculate the amounts of materials 
needed to paint a room and put up wallpaper border. 

This study looked at the roles that competition and context of advisement have on 
transfer, advisor use, attitude toward mathematics, and attitude toward the instruction in a 
computer-based simulation game requiring the use of mathematics skills. Advisor use 
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was also examined in relation to transfer, attitude toward mathematics, and attitude 
toward instruction. 

Competition referred to whether the participant was competing against a 
computer-generated character or not. Context of advisement referred to whether the 
advisor was a text-based reference book or a text-based reference book plus a video of 
the player’s aunt and uncle walking into the room. With the addition of a control group 
who received only word problems in a computer-based tutorial format, this resulted in 
five conditions: 

1 . Control (a word problem-based computer version of the content in the simulation 
game and simulation) 

2. Competitive simulation game and high-contextual advisement (video of aunt and 
uncle plus the reference book) 

3. Non-competitive simulation and high-contextual advisement 

4. Competitive simulation game and low-contextual advisement (text based reference 
book of formulas only) 

5. Non-competitive simulation and low-contextual advisement 

Advisement use was expected to be related to transfer of mathematics skills 
overall. High-contextual advisement, i.e., video-based, was expected to result in higher 
transfer of mathematics scores than low-contextual advisement. It was also hypothesized 
that high-contextual advisement would lead to higher ratings of the instruction and 
attitude toward mathematics and result in higher advisement use. 

The low-contextual version was expected to result in lower advisement use, lower 
transfer of mathematics scores, lower ratings of the instruction, and lower attitude toward 
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mathematics, primarily because transfer tasks in authentic environments might be 
expected to constitute new learning, which has been shown to be negatively impacted by 
competition. Also, because certain types of competition place a premium on time as well 
as accuracy, learners might be expected to take less time for processing information, 
searching the problem space, and seeking advisement, thereby leading to lower transfer 
scores. 

BACKGROUND 

Transfer 

Despite the importance of transfer of learning in education, learners in general do 
not transfer learning (Thurman, 1993; Asch, 1969; Brown, 1989; Perfetto, Bransford, and 
Franks, 1983; Gick & Holyoak, 1980; Reed, Ernst, & Banerji, 1974; Simon & Hayes, 
1976; Weisberg, DiCamillo, & Phillips, 1978; CTGV, 1992a, 1992b; Van Haneghan, 
1990). Some researchers attribute the failure to transfer learning to a lack of similarity 
between the learning and performance contexts (e.g., Osgood, 1949) or the lack of 
similarity between new and old problems, lack of previous experience with similar 
problems, and lack of instruction about how to conceptualize and solve problems (Rogoff 
& Gardner, 1984). Others explain the failure to transfer learning as the lack of perceived 
similarity between the learning and performance contexts. This latter assertion is what 
cognitivists such as Gick and Holyoak (1980) call the perceptually bound hypothesis. 

Context alone is not responsible for the failure to transfer. Context can also 
interact with the medium and with learner characteristics such as attitude toward transfer 
(Tessmer & Richey, 1997). Low self-efficacy and attitude toward content may also cause 
failure to transfer (Kraiger, Ford, & Salas, 1993). There is also evidence that problem 



solving and transfer are largely domain specific, so transfer is not likely to occur as the 
result of general problem-solving instruction (Larkin, 1989), but instead requires multiple 
practice opportunities in a variety of contexts (Gagne, Briggs, & Wager, 1992). 

One means of promoting transfer of learning involves making the connection 
between the learning context and performance context explicit through prompting, 
cueing, or other means (Adams et al., 1988; Lockhart et al., 1987; Brown, 1989; Gick & 
Holyoak, 1980; Hayes & Simon, 1977; Perfetto et al., 1983; Reed et al., 1974; Simon & 
Hayes, 1976; Weisberg et al., 1978). Likewise, for insight problems (those that require 
reconceptualizing the problem), helping learners to think about the problem in a new way 
has been shown to increase transfer of learning (Lockhart et al., 1987). 

The context of mathematics learning in formal instruction often consists of word 
problems and textbooks, yet learners are routinely required to apply mathematics skills in 
contexts in the real world that often differ, sometimes radically, from traditional word 
problems. Transfer in this study is categorized as horizontal transfer because the 
participants will be applying previously learned mathematics skills in a new context 
beyond what may be found in most traditional mathematics instruction. Specifically, 
students who studied area, volume, perimeter, addition, subtraction, multiplication, 
division, and calculation of equivalent measurements were required to apply this prior 
learning to determine the amount of paint and wallpaper border needed to remodel a 
room in a house. 
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Operational Definition 

Transfer in this study, then, may be considered positive horizontal transfer. 
Positive horizontal transfer is the activation, retrieval, and application of previously 
acquired mathematics skills to the successful solution of a problem set in a novel context. 
Novel, using Royer’s (1979) terminology, refers to a context in which the stimulus 
elements differ from the stimulus elements in the original learning context. In this study, 
transfer as defined above will be measured by the ability to select and apply relevant 
formulae to the solution of two problems in a simulation game. 

Attitude 

Research has found that “pleasant items are usually processed more efficiently 
and more accurately than less pleasant items” in perception, language, and decision 
making (Matlin, 1998, p. 143). This principle is known as the Pollyaima Principle. We 
recall pleasant items first (Matlin, 1998). Other research has shown that pleasant words 
are recalled more easily and with higher frequency than are neutral or negative words, 
especially when there is a long delay between learning and performance (Matlin & Stang, 
1978). 

The ability of affective response toward pleasant stimuli and content to improve 
learning and performance may extend as well to stimuli and content that are considered 
interesting, which is not necessarily the same thing. Theory holds that if the learner 
enjoys or is interested in the content, he or she may increase the cognitive elaboration and 
effort put forth in processing that material (e.g., Brophy, 1987; Midi & Baird, 1986; 
Greene & Lepper, 1974; Malone, 1981; Collins, Brown, & Newman, 1989). Bandura 
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(1977) believes that changes in self-efficacy and attitude toward content lead to changes 
in effort and, subsequently, to changes in performance. 

The issue of making instruction interesting is perhaps of particular importance to 
mathematics, since interesting content may promote positive attitude towards 
mathematics in general. Performance in mathematical problem solving is related to 
beliefs about mathematics (Schoenfeld, 1983, 1985), and attitude toward mathematics 
can determine the likelihood of continued study and perseverance (Lehman, 1987). 

Poor attitude toward content can result in poor learning and performance in 
mathematics areas (Gal & Ginsburg, 1994). Attitude toward the content, in particular 
students’ expectations of success, is positively correlated with student’s persistence and 
success. For instance, self-efficacy may predict performance (Kraiger et al., 1993) and 
has been linked to performance and persistence (Barling & Beattie, 1983; Stumpf, Brief, 
& Hartman, 1987; Weinberg et al., 1979). Attitudes, therefore, perhaps especially in 
mathematics, are important considerations in learning. 

Operational Definition 

This research measured self-reported affective response toward mathematics as a 
content area and toward the game. This is a common definition and approach in 
educational research, with good support in the literature, particularly with mathematics 
(e.g., Gagne et al., 1992; Kraiger et al., 1993; Lehman, 1987). 

Anchored Instruction 

Anchored instruction, as developed and explicated by John Bransford, Robert 
Sherwood, T. Hesselbring, C. K. Kinzer, and S. M. Williams (1990), the Cognition and 



Technology Group at Vanderbilt (CTGV), and Van Haneghan et. al. (1992), is an 
approach to learning that stresses the importance of embedding (or anchoring) the 
learning within a meaningful, problem-solving context. It is related to situated cognition 
theory, which says that learning that takes place in a realistic context will be more 
effective than learning that does not. 

According to anchored instruction, a learner who is studying basic mathematics 
skills such as addition, multiplication, and division will have great difficulty if he or she 
studies the formulas and rules outside of a meaningful context. This is why mathematics 
curricula often make use of word problems, which attempt to situate the skills in “real- 
world” problems. The higher the fidelity between the situation and the “real world,” 
according to anchored instruction, the higher the transfer should be. Anchored instruction 
has been experimentally shown to promote performance and transfer (Sherwood & the 
Cognition and Technology Group at Vanderbilt [CTGV], 1991; CTGV, 1993; Van 
Haneghan et al., 1992) and to be more effective in teaching mathematical problem- 
solving skills than traditional instruction (Griffin, 1995). 

Computers and Gaming 

Instructional games present an excellent opportunity for problem-solving skills 
and transfer of prior learning. They are, if well designed, motivating and entertaining. 
According to Dempsey et al. (1997), “computer games have been employed effectively in 
all areas of traditional schooling — from preschool . . . through higher education . . . and 
continuing education of the elderly” (p. 1). Among the many potential strengths of 
instructional games are complex problem-solving skills (Hayes, 1989). Instructional 
games have been used successfully in teaching social theory (Coleman, 1989), 



mathematics (Bright, Harvey, & Wheeler, 1985), and combat skills (Kent, 1999; Wood, 
1997) and have been suggested for teaching language fluency (Baltra, 1990). 

Most research in instructional games has been designed to address achievement, 
problem solving, attitude, retention, and continued motivation (Dempsey et al., 1993). 
Transfer in simulations and games has be virtually ignored (Jacobs & Dempsey, 1993). 
Simulation games should be successful in promoting transfer by incorporating anchored 
instruction principles. 

A review of the literature suggests that CBl and simulation games are also good 
for improving attitude and motivation (Druckman, 1995; Seginer, 1980; Thurman, 1993; 
Haimafin & Peck, 1988; Heyman, 1982; Brophy, 1987; Duin, 1988; Lepper & Chabay, 
1985; Sedighian & Sedighian, 1996). In fact, CBl and games may be an ideal medium for 
studying the motivational effects of different instructional activities and processes overall 
(Lepper & Milojkovic, 1986). 

Operational Definition 

For the purposes of this study, simulation games are defined as an interactive 
experience that contains some representation of a world, real or imagined, that behaves 
according to a coherent (if not realistic) set of rules, in which the participant(s) often have 
a clear goal, the pursuit and attainment of which may result in an entertaining, rewarding 
experience. In this study, competition is viewed as a separate variable, which may be 
present or absent in a simulation game. 
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Competition 



According to Klein, Freitag, and Wolf (1990) there is a schism in the field of 
instructional gaming research regarding the effectiveness of games and this schism can be 
at least partially traced to differing views on the role of competition in gaming: “[some] 
educators argue that instructional games are effective for providing motivating practice of 
newly acquired skills and information .... Other scholars argue that the competition 
element decreases student motivation” (p. 330). Competition does not function identically 
in all situations, however, and to reduce the argument to the level of “competition is 
good” or “competition is bad” is an oversimplification that ignores some very important 
considerations. For instance, competition alone ca nn ot make learners function beyond 
their maximum ability unless they have help, such as a coach, mentor, or advisor. 

There is some evidence that competition can create anxiety, which can interfere 
with higher order intellectual skills such as problem solving (Goodman & Crouch, 1974), 
and while there is research that indicates competition can increase performance, the 
domains used in these studies rarely involved higher-order intellectual skills such as 
problem solving. This becomes a critical distinction later which might help explain the 
apparently contradictory research on the role of competition in learning. 

While a great deal of research has been done on both transfer and competition in 
general, no studies could be found that examined the effects of competition on transfer. In 
theory, competition might be expected to increase anxiety and to reduce elaboration, both 
of which could inhibit transfer. 
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Some researchers have found that competition can increase performance (e.g., 
Julian & Perry, 1967; Craig, 1967; Fisher, 1976; Spalt, 1987/1988; Kraft Miller, 1981), 
while others have found just the opposite (e.g., Keefer & Karabenick, 1998; Cartmill, 
1994; Thompson, 1972). It may be that competition can improve performance, but that 
the means and extent to which it does so are at least partially determined by the content, 
the complexity of the learning, familiarity with the content, the nature of who is 
competing against whom, and other situational characteristics. Likewise, it seems logical 
to conclude that there may be some conditions (e.g., learner characteristics, domain) 
under which competition can be detrimental. The research studies which show benefits of 
competition appear to focus on knowledge measures and content in non-problem solving 
contexts (i.e., at the rule and verbal information levels) and in nonauthentic contexts (i.e., 
school-based contexts rather than “real world” contexts). It might be expected that such 
learning requires less cognitive processing than higher-order learning such as problem 
solving (the most common venue for transfer learning studies). 

Another factor which may account for the conflicting results of competition 
studies may lie in the level of expertise and familiarity in the content to be learned. Miller 
and Reward (1992) advocate using time trials, and kind of competition, to promote 
mathematics fluency. Knowing the correct answer to a mathematical operation, they say, 
is only a partial measure of competence; teachers should also look at how long it takes to 
generate the answer. Central to their argument and to the current discussion of 
competition is the stage learning the student has attained relative to the content. They 
identify two basic stages of knowledge acquisition, the acquisition stage and the practice 
stage. In the acquisition stage, the goal is for the learner to learn how to do the skill. 

10 
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Instruction should therefore focus on teaching the student to perform the skill correctly 
and accurately. Time trials (competition) should not be used during this stage. Once the 
learner has begun to make more correct responses than erroneous responses, instruction 
should begin to shift into time trials. By extension, competition at the acquisition stage 
might then be expected to result in negative results in performance. There are few studies 
that examine how competition interacts with learner characteristics or mode of instruction 
in problem solving/transfer tasks. 

Operational Definition 

For the purposes of this discussion, competition is defined as any condition in 
which learners are able to compare their performance to some internal or external 
standard, or to significant others in the social environment in groups or individually, in 
such a way that they can tell if they are below, at, or above the reference performance 
mark. 

In this study, competition was created by the presence or absence of a computer 
generated competitor. An argument could be made that competing against a computer- 
generated character is not competition in the same sense that competing against a human 
being is. On the other hand, some authors have said that simply adding a scoring 
mechanism to a simulation can qualify as competition because the player then has an 
external reference and is able to compete against themselves (Jacobs & Dempsey, 1993). 
Additionally, many video arcade games and console games use computer generated 
“competitiors.” It is in this sense of the definition competition is used and discussed in 
this study. 
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Advisement 



Studies have shown that CBI that uses learner control with advisement is as 
effective or more effective than adaptive control or learner control without advisement 
(Johansen & Tennyson, 1983; Tennyson, 1980a, 1980b; Tennyson & Buttrey, 1980). 
Decreases in instructional time under learner control with advisement were also found 
when compared with adaptive instruction (Gray, 1988; Tennyson, 1980a, 1980b, 1981). 

Advisement as it has been discussed and examined in the literature generally 
refers to one of three things; advisement about the optimal path or sequence through the 
instruction, feedback advice about performance and suggestions for number of examples 
or practice items to attempt, or advice about whether or not to seek additional instruction 
(e.g.. Gray, 1988; Johansen & Tennyson, 1983; Tennyson, 1980a, 1980b; Tennyson & 
Buttrey, 1980). Research in these areas has produced somewhat mixed results, but most 
researchers seem to agree that learners are generally not able to effectively manage their 
learning without advice (i.e., under learner control with no advice — Carrier, 1984; Fisher 
et al., 1975; Park & Tennyson, 1980; Reinking, 1983; Tennyson, 1980a, 1980b; 

Tennyson and Buttrey, 1980). 

None of these various types of advisement help learners process content or clear 
up misconceptions — roles usually addressed by a teacher in traditional instruction. This 
type of advisement strategy can be found in several commercially available instructional 
multimedia programs. For example. Shoot Video Like a Pro provides talking-head 
“experts” who provide learners with tips to improve their emerging skills. The experts in 
this software are built into the camera-like interface, are both male and female, and come 
from a variety of ethnic backgrounds. Essentially, these advisors “coach” by explaining a 
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different perspective from the main flow of the program, rather than adapting to, 
directing, or evaluating the learner’s performance. It is this level of coaching help that 
can free teachers to address higher-order instructional needs. Some research is beginning 
to explore this idea (Dempsey & Van Eck, 1998; Wu, 1992; Zellermayer, Salomon, 
Globerson, & Givon, 1991). 

Operational Definition 

Advisement in the sense of a learning coach who prompts learners to find their 
own way through a problem will serve as the definition for this study. Specifically, 
advisement will be a system that is under learner control, and that will provide cues and 
prompts about how to approach a particular problem. 

Context of advisement refers to the internal and external events associated with 
the delivery of advice. In this research, advisement has either a high or low level of 
correspondence between the learning context and the type of advisement. In the high- 
level condition, the advisors consist of two carpenters who discuss the process for solving 
the problem as well as a text-based reference book of formulas and facts (reference book) 
built into the game. This is considered high because the advisors are integrated into the 
story line. In the low-level condition, the advisor is just the text-based listing of the 
formula and facts (reference book). This is considered low-level because the advisor is 
abstract and unrelated to the story line. 
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Research Questions and Hypotheses 



Advisement 

Research shows that advisement is good for promoting learning and attitude 
toward instruction and content. No research could be located on how advisement may 
impact transfer, however. Because failure to transfer is usually the result of a failure to 
recognize the relevance of prior knowledge in novel contexts, advisement could 
theoretically promote transfer by making these connections specific. Instruction that uses 
advisement to train learners to recognize these connections on their own should lead to 
improved transfer in future contexts. Researchers seem to have ignored the use of 
advisement in the context of games or anchored instruction. The inclusion of advisement, 
which acts like scaffolding, in a computer game can help support the teacher in the role 
of co-leamer or coach , which is required by anchored instruction and situated learning. 
The impact of context of advisement (i.e., whether the advisement is related to the 
instructional metaphor or not, or whether the advisement is interesting or not) on 
learning, attitude, and advisor use has also not been explored. By making the advisor 
entertaining, the learners may select it more often. 

Related Research Questions: 

1 . Does advisor use affect transfer of mathematics skills? 

2. Does advisor use affect attitude toward instruction? 

3. Does advisor context affect advisor use? 

4. Does advisor context affect attitude toward instruction, mathematics, and 
the simulation game? 
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Related Alternative Hypotheses: 



1 . Participants who select advisement will have higher transfer of 
mathematics scores. 

2. Participants who select advisement will have higher attitude toward 
mathematics scores. 

3. Participants with access to high-contextual advisement will select 
advisement more often than those who have access to low-contextual 
advisement. 

4. Participants with access to high-contextual advisement will have higher 
transfer of mathematics scores than those who have access to low- 
contextual advisement. 

5. Participants with access to high-contextual advisement will have more 
positive attitude toward mathematics. 

6. Participants with access to high-contextual advisement will have more 
positive attitude toward the computer simulation game than those who 
have access to low-contextual advisement. 

Competition 

Games often involve competition, so it is logical to build competition into an 
instructional game. But limited research on competition in instructional games and 
mathematics instruction exists, and what does exist does not provide a definitive answer 
on the benefits or detriments of competition. Time stress and competition have been 
shown to build fluency but have shown detrimental effects in learning in studies of 
mathematics and language acquisition, as well as on attitude and self-efficacy. Because 
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the transfer problems in this study require higher-order intellectual skills, and because 
they are likely to constitute learning at the acquisition stage rather than the practice stage 
(Miller & Reward, 1992), it might be expected that competition will have a negative 
effect on transfer. Likewise, competition in this study may promote advisor use and 
transfer (through a heightened desire to perform well), or it may raise anxiety, which can 
interfere with performance, especially in those with mathematics anxiety already. 

Related Research Questions: 

1 . Does competition affect transfer of mathematics skills? 

2. Does competition affect advisor use? 

3. Does competition affect attitude toward instruction, mathematics, and the 
computer game? 

Related Alternative Hypotheses: 

1 . Participants in the competitive simulation game conditions will not differ 
from those in the non-competitive simulation game conditions in terms of 
transfer of mathematics scores. 

2. Participants in the competitive simulation game conditions will not differ 
from those in the non-competitive simulation game conditions in terms of 
advisement use. 

3 . Participants in the competitive simulation game conditions will not differ 
from those in the non-competitive simulation game conditions in terms of 
attitude toward mathematics 
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4. Participants in the competitive simulation game conditions will not differ 
from those in the non-competitive simulation game conditions in terms of 
attitude toward the computer game scores. 

Anchored Instruction 

Anchored instruction has been shown to promote transfer of mathematics skills. It 
is usually of a non-interactive nature, however, and does not take the form of a game, but 
of a lesson. Computer games have been shown to increase learning, and promote 
persistence and positive affective response toward instruction. Anchored instruction has 
been shown to promote transfer, but it is unclear if a game can function in a similar 
fashion. 

Related Research Questions: 

1 . Can an instructional simulation game promote transfer learning? 

2. Does an instructional simulation game have an effect on attitude toward 
mathematics? 

Related Alternate Hypotheses: 

1 . Participants in the instructional competitive and non-competitive 
simulation game conditions will not differ from those in the control 
condition in terms of transfer of mathematics scores. 

2. Participants in the instructional competitive and non-competitive 
simulation game conditions will not differ from those in the control 
condition in terms of attitude toward mathematics scores. 
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METHOD 



Participants 

The target population for this study is middle-school-aged children in grades 7 
through 8, with a range in age from 1 1 years to 14 years old. This population was 
available at several middle schools, of which four were selected: School A (n = 75), 
School B (n = 50), School C (n = 123), and School D (n = 80). Schools B and A were 
used for pilot testing and field trials (respectively) of the game, and School D was unable 
to participate in the last instance. Accordingly, the sample for this study included students 
at School C only. Standardized reading and math scores were unavailable for School C. 
Participants have regular access to the computer lab and access to an edutainment game 
on math as well as other knowledge and entertainment games during free lab time. 

Demographic data were collected via self-reported instruments developed for this 

study. 

Materials and Instruments 
Lesson Content 

The content of the lesson was delivered via a computer-based instructional 
simulation and simulation game and was developed using the NCTM 2000 mathematics 
curriculum standards which will form the basis of the Voluntary National Test of 
Mathematics (VNTM) currently under development at the national level. Because this 
instruction reflects the content outlined by the NCTM 2000 standards, learners will gain 
practice in the areas that will make up the VNTM. Learners were able to get practice in 
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“real-world” scenarios, something that is specified by the NCTM 2000 standards. In 
particular, the content covered portions of NCTM 2000 content strands 1, 2, and 3*. 

Problems based on these goals and standards were developed and integrated into 
an instructional simulation game in which participants play a peer-aged character who is 
working for their aunt and uncle’s home remodeling business. Participants are given a 
room in a house for which they must calculate how much paint and how much wallpaper 
border to purchase. 

Lesson Materials 

A computer-based instructional simulation game was developed using 
Macromedia Authorware for Windows 95/98. This simulation game made extensive use 
of graphics, sound, video, and interactivity. Participants entered a room in a computer- 
generated house and navigated around in it by clicking in the direction they wanted to go. 
They were able to use a variety of tools in the simulation game, including a tape measure 
to measure walls, doors, and windows, a workbook in which to record information used 
to solve the problem, a reference book to look up facts and formulas, a calculator, and, in 
some conditions, a walkie-talkie to call the video advisors for advice. Participants used 
these tools to learn about the environment (how long/high a wall is, for instance) and 
solve two problems: how much paint to buy for the walls and how much wallpaper 
border to put around the room at ceiling height. They recorded their observations in the 



' Numbers and letters represent the numbering scheme developed for the NCTM standards. Not 
every component of every strand was represented in this study, which is why some letters do not appear in 
sequence (e.g., a, d, e instead of a, b, c, d, e). 
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workbook built into the simulation game. The room was rectangular in shape and had a 
square window, a round window, a rectangular window, one door, and one doorway. The 
ceiling of the room was vaulted, resulting in a triangular prism (two walls were triangles, 
the other two were rectangles). The shapes thus represented in the room were ten 
rectangles, two triangles, one circle, and one square. Participants in the control group 
were given word problems identical to those in the computer simulation game in the form 
of a computer tutorial to minimize any differences or resentment due to medium. 

Context of Advisement 

Advisement was available to all participants in the simulation game. Because of 
the short length of the invervention (50 minutes) and the difficulty in assessing the 
correctness of formulas as entered or described by participants, a reference book 
containing a variety of facts and formulas was provided in both the simulation game. The 
goal was to measure the ability to apply prior knowledge, not to see if participants had 
memorized the relevant formulae. Such support devices are common in many computer 
games. In addition to this reference book, some participants received video-based 
advisement in which their Aunt Ann and Uncle Bob discussed the problem and the 
solution process. This type of advisement has a high contextual relevance to the storyline 
of the game itself These two conditions of advisement are referred to in this study as 
high- and low-contextual advisement. 

Competition 

Competition was determined by the presence or absence of a computer-generated 
competitor. In the competitive environment, participants were told to work quickly 
because they were competing against a computer character. They were asked to indicate 
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the level of competitor they want, either below average, average, or above average. The 
goal was to solve the problem faster and more accurately than their competitor. This 
competitor would randomly make comments about his or her progress throughout the 
game. In the noncompetitive environment, participants had no opponent to compete 
against for time or accuracy, but they were encouraged to work quickly and accurately. 
Controls 

Controls were given computer-based word problems that were identical to those 
in the simulation game and simulation. They had no access to advisement, nor was any 
element of competition involved. 

Assessment Instruments 

Six assessment instruments were used in this study; a demographics survey, an 
attitude toward mathematics inventory, a pretest, an attitude toward a computer game 
scale, a debriefing questionaire, and a posttest transfer of mathematics skills assessment 
game. 

Demographics Survey 

In order to collect data for possible use as covariates and for post hoc 
examinations, a demographic survey was developed to collect data on age, sex, ethnic 
background, computer experience, mathematics experience, game playing behavior, 
hours spent on schoolwork and other activities. This scale had a Flesch-Kincaid Grade 
Level reading score of 3. 1 . 

Pretest 

A pretest was developed to assess incoming mathematics skills. This was 
necessary because while students have had the relevant content, no objective measure of 
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mastery is available. Pretest scores were collected to verify that students were capable 
performing the mathematical computations required in the simulation game and 
simulation. This instrument had a Flesch-Kincaid Grade Level reading score of 5.2. 

Attitude Toward Mathematics 

This construct was measured by the Mathematics Beliefs Scale: a 64-question, 
five-item, Likert-type scale compiled by James P. Van Haneghan and Daniel Hickey in 
1993. This scale, provided to the researcher by Dr. Van Haneghan, was compiled from 
several scales. Table 1 presents the scales and their origins. 
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Table 1 



Math Beliefs Survey Scales by Originating Authors 



Scale 


Author 


Task Orientation 


Nicholls, 1990) 


Ego Orientation 


Nicholls, 1990) 


Work Avoidance 


Nicholls, 1990) 


Math Anxiety 


Van Haneghan & Hickey, 1992; Fennema & Sherman, 1976 


Confidence in Math 


Van Haneghan & Hickey, 1992; Fennema & Sherman, 1976 


Ability 




Interest 


Nicholls, 1990 


Understanding 


Nicholls, 1990 


Competititveness 


Nicholls, 1990 


Effort 


Kloosterman & Stage, 1992 


Time Consuming 


Kloosterman & Stage, 1 992 


Challenging 


Van Haneghan & Hickey, 1992 


Utility 


Kloosterman & Stage, 1992 



This scale is composed of 12 different mathematics beliefs scales, with Cronbach 
alphas ranging from .44 to .91, with four falling below .70. Past principle components 
analyses indicated the presence of three components, accounting for 62% of the variance: 
confidence in mathematics ability, task orientation/causes of success in mathematics, and 
work avoidant/ego orientation. 
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Attitude Toward Computer Game 

This construct was measured by the Computer Game Attitude Scale developed by 
Kelly Chappell and Catherine Taylor (1997). Based on the Computer Attitude Scale 
(Loyd & Gressard, 1984), this scale is designed to evaluate attitudes toward educational 
software games. This scale is comprised of 20 questions, each with a four-item, Likert- 
type response. A factor analysis revealed two factors: comfort and liking. Cronbach 
alphas were .86 for the comfort subscale and .84 for the liking subscale. Overall test 
Cronbach alpha was .88. This scale had a Flesch-Kincaid Grade Level reading score of 
3.8. 

Transfer Assessment Simulation Game (PosttesB 

Transfer of mathematics skills was assessed via a second computer-based 
instructional simulation identical in structure and general content but differing in the 
setting. Whereas the simulation game and simulation context in the intervention consisted 
of a room in a house, the transfer posttest was assessed by a simulation set in a movie 
theater. Instead of calculating the amount of paint needed for the walls, participants 
calculated the amount of material to buy to replace the movie curtain; instead of the 
number of rolls of wallpaper border needed for a room in a house, participants calculated 
the number of aisle carpet rolls needed to replace the carpet running around the outside of 
the theater seating area. The skills and formula required are identical to the earlier 
simulation game and simulation, but the context and calculations varied. No advisement 
was available, nor was there any element of competition present in this simulation. 
Transfer was measured both by the ability to select the correct formula and to solve the 
problem correctly (i.e., either was counted as correct). While transfer might theoretically 
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be measured by the selection of the formula alone, some participants are more 
sophisticated problem-solvers and may be able to solve the problem intuitively (i.e., 
without selecting the formula from the reference book). Because no formulas beyond the 
correct one for a given problem would produce the same answer, and because the 
likelihood of guessing the right answer without using the correct formula was small, it 
was felt that a correct answer indicated having used the correct formula. 

Debriefing Questions 

Debriefing questions were formulated to gather specific information after the 
study. This instrument had a Flesch-Kincaid Grade Level reading score of 3.2. 

Research Design 

There were ten research questions examined in this study, each resulting in the 
following alternative hypotheses: 

1 . Participants who select advisement more often than others will have higher 
transfer of mathematics scores. 

2. Participants who select advisement more often than others will have more positive 
attitude toward mathematics scores. 

3. Participants with access to high-contextual advisement will select advisement 
more often than those who have access to low-contextual advisement. 

4. Participants with access to high-contextual advisement will have higher transfer 
of mathematics scores than those who have access to low-contextual advisement. 

5. Participants with access to high-contextual advisement will have more positive 
attitude toward mathematics than those who have access to low-contextual 
advisement. 
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6. Participants with access to high-contextual advisement will have more positive 
attitude toward the computer simulation game than those who have access to low- 
contextual advisement. 

7. Participants in the competitive simulation game conditions will have lower 
transfer of mathematics scores than participants in the non-competitive simulation 
game conditions. 

8. Participants in the competitive simulation game conditions will select advisement 
less often than do participants in the non-competitive simulation game conditions. 

9. Participants in the non-competitive simulation game conditions will have more 
positive attitude toward mathematics than do participants in the competitive 
simulation game conditions. 

10. Participants in the non-competitive simulation game conditions will have more 
positive attitude toward the game scores than do participants in the competitive 
simulation game conditions. 

1 1 . Participants in competitive and non-competitive simulation game conditions will 
have higher transfer of mathematics scores than do participants in the control 
condition. 

12. Participants in competitive and non-competitive simulation game conditions will 
have more positive attitude toward mathematics scores than do participants in the 
control condition. 

The experimental design for all research questions was a randomized pretest- 
posttest design with two independent variables and four dependent variables, resulting in 
a non-crossed 2X2 with control group design (see Table 2). Participants were randomly 



assigned to conditions beforehand, but participated as a class during their normal class 
time. Because the dependent variables were deemed unrelated, each was examined using 
a separate statistical analysis procedure. Independent variables include context of 
advisement (advisement as either a text-based formula or text-based formula plus video- 
based discussion of problem, process, and formula) and mode of instruction (with or 
without competition). Dependent variables include attitude toward mathematics, attitude 
toward game, transfer scores, and advisor use. 



Table 2 

Research Design of Study 



Context of Advisement 


Competition 






Competition 


No Competition 


Control 


Low-Contextual Advisement: 








(Reference Book Only) 
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24 


Hiah-Contextual Advisement: 








(Reference Book & Video 
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Discussion) 









Null Hypotheses 

The research questions resulted in the following 16 null hypotheses: 

1 . Participants who use advisement more often than others will not differ in 
transfer of mathematics scores. 
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2. Participants who use advisement more often than others will not differ in 
attitude toward mathematics scores. 

3. Participants in the high-contextual advisement conditions will not differ from 
participants in the low-contextual advisement conditions in terms of 
advisement use. 

4. Participants in the high-contextual advisement conditions will not differ from 
participants in the low-contextual advisement conditions in terms of transfer 
of mathematics scores. 

5. Participants in the high-contextual advisement conditions will not differ from 
participants in the low-contextual advisement conditions in terms of attitude 
toward mathematics scores. 

6. Participants in the high-contextual advisement conditions will not differ from 
participants in the low-contextual advisement conditions in terms of attitude 
toward the computer game scores. 

7. Participants in the non-competitive simulation game conditions will not differ 
from those in the competitive simulation game conditions in terms of transfer 
of mathematics scores. 

8. Participants in the non-competitive simulation game conditions will not differ 
from those in the competitive simulation game conditions in terms of 
advisement use. 

9. Participants in the non-competitive simulation game conditions will not differ 
from those in the competitive simulation game conditions in terms of attitude 
toward mathematics scores. 
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10. Participants in the non-competitive simulation game conditions will not differ 
from those in the competitive simulation game conditions in terms of attitude 
toward the computer game scores. 

1 1 . Participants in the competitive and non-competitive simulation game 
conditions will not differ from those in the control condition in terms of 
transfer of mathematics scores. 

12. Participants in the competitive and non-competitive simulation game 
conditions will not differ from those in the control condition in terms of 
attitude toward mathematics scores. 

13. There will be no interaction of context of advisement and competition on 
transfer of mathematics scores. 

14. There will be no interaction of context of advisement and competition on 
attitude toward mathematics scores. 

15. There will be no interaction of context of advisement and competition on 
attitude toward game scores. 

16. There will be no interaction of context of advisement and competition on 
advisor use. 

Procedures 

Formative Evaluation: The Simulation Game 

The simulation game was piloted on twenty members of the target population and 
revised accordingly. The simulation game was then formative ly evaluated on 10 members 
of the target population and modified further. The simulation game was then field tested 
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on 75 members of the target population, and minor changes were made based on 
observations of their performance. 

Experiment 

Participants were selected from seventh- and eighth-grade classes at a local 
middle school and assigned in a stratified random manner to one of five conditions: low- 
contextual advisement with competition, low-contextual advisement without competition, 
high- contextual advisement with competition, high-contextual advisement without 
competition, or control. After random assignment to conditions, participants were run by 
existing class, that is, members of each mathematics class were randomly assigned and 
run as an intact group for the duration of the study. 

Session/Dav 1 teach class) 

All participants were given a participant number and read the same orienting 
instructions explaining the purpose and process of the study. This process took 
approximately 10 minutes. They were then able to ask questions by raising their hand. 
Participants were then given the demographics survey, the Math Beliefs Survey, and the 
pretest, all in computer form, which took approximately 45 minutes to complete. 

Session/Dav 2 teach classl 

Participants returned two days later and began the simulation game tutorial, which 
was designed to orient them to such issues as the program interface (including all tools 
within the game) and navigation. They were unable to proceed until they had 
demonstrated the use of each tool and element of the interface one time. The orientation 
tutorial took approximately five minutes to complete. 
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Participants then began playing the simulation game (experimental groups) or 
working with the identical on-line word problems (controls). The computer session lasted 
approximately 45 minutes. Data were collected during the game via the computer and 
stored as text files for later retrieval. A debriefing form was given to the participants to be 
filled out and returned later. The teachers were instructed not to discuss or teach the 
content of the game (i.e., area and perimeter) between sessions. 

Session/Dav 3 (each class') 

One week after the second session, the posttest (the transfer simulation), 
Mathematics Beliefs Survey and the Computer Game Attitude Scale were administered. 
Participants were then debriefed about the actual nature of the study and informed that 
they can all play the game whenever their teacher gives them time to do so. 

Data from the instruments and the game and computer-based word problems 
(controls) were input directly from the computer-generated files into SPSS. After data 
screening for outliers and normality, and after checking for appropriate statistical 
assumptions, ANOVA, MANOVA, bi-variate correlation, and chi-square analyses were 
performed to test the null hypotheses. 
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RESULTS 



Introduction 

In the interests of space, only those null hypotheses which were not supported are 
discussed. All other null hypotheses were supported. 

Data Screening 

Variables were screened for outliers, normal distribution, skewness, and kurtosis. 
Outliers were removed on a case-by-case basis. Assumptions for the statistical measures 
used were checked. With the exception of the advisor-use variable, all fell within 
acceptable parameters for the inferential statistics used. Advisement use was found to be 
negatively skewed and was transformed (square root) prior to use in analyses. 

Descriptive Statistics 

Sixteen null hypotheses were examined to see if there were significant differences 
between and among various groups in terms of advisement use, transfer of mathematics 
scores, attitude toward mathematics, and attitude toward the game. Tables 3 and 4 present 
demographic data. Tables 5, 6, 7, 8, and 9 present means and standard deviations for 
dependent variables by condition. 

Table 3 



Age. Gender. Grade, and Pretest Math Scores 









Age 


Gender 


Grade 


M SD 


Male Female 


7 8 


12.8 0.67 


54 58 


41 48 
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Table 4 



Ethnicity of Participants 



African American 


Hispanic 


Asian 


Caucasian 


Other 


5 


2 


1 


99 


4 



Table 5 

Advisor Use and Transfer of Mathematics Scores by Condition 



Condition 



0 1 2 3 4 Total 

(n=17) (n = 17) (n=12) (n=18) (n = 84) 

(n = 20) 



Dependent Variable 

M^MSD MSD MSD 
Advisor Use 8.29 4.62 5.28 3.97 4.42 2.87 3 2.5 5.28 4.08 

Transfer Score .88 .68 1.23 .85 .76 .83 .71 .69 .92 .84 .88 .79 
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Table 6 



Attitude Toward Mathematics at Pretest bv Condition 



Condition 





0(n 


= 20) 


l(n 


= 17) 


2(n 


= 17) 


3(n^ 


= 12) 


4(n 


= 18) 


Total (n = 84) 


Scales 


M 


SD 


M 


SD 


M 




M 


SD 


M 


SD 


M 




Ego 


3.50 


0.86 


3.61 


0.90 


3.38 


0.87 


3.68 


0.78 


3.80 


0.81 


3.60 


0.84 


Task Ori- 


3.73 


0.61 


3.61 


0.58 


3.56 


0.81 


3.58 


0.74 


3.80 


0.47 


3.66 


0.65 


entation 


























Work 


3.18 


0.94 


3.30 


1.03 


3.21 


1.01 


3.35 


1.00 


3.49 


1.05 


3.31 


0.99 


Avoidance 


























Interest 


4.15 


0.89 


4.50 


0.47 


4.38 


0.47 


4.15 


0.71 


4.33 


0.47 


4.29 


0.64 


Under- 


3.94 


0.56 


3.98 


0.49 


3.95 


0.52 


3.96 


0.44 


4.03 


0.45 


3.97 


0.49 


standing 


























Competi- 


3.17 


0.71 


3.13 


0.92 


2.83 


0.81 


3.32 


0.85 


2.75 


0.85 


3.04 


0.84 


tion 


























Ability 


3.69 


1.02 


3.94 


0.66 


4.17 


0.45 


3.83 


0.76 


3.77 


0.66 


3.87 


0.75 


Challenge 


3.27 


0.83 


3.29 


0.76 


3.34 


0.76 


3.22 


0.91 


3.21 


0.79 


3.26 


0.80 


Anxiety 


2.89 


0.88 


2.72 


0.73 


2.63 


0.76 


2.80 


0.87 


3.16 


0.82 


2.85 


0.82 


Utility 


4.10 


0.66 


4.16 


0.46 


3.95 


0.63 


3.98 


0.73 


4.16 


0.63 


4.07 


0.63 



(table continues) 
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Table 6, continued 



Condition 


0(n 


= 20) 


l(n 


= 17) 


2 (n 


= 17) 


3 (n 


= 12) 


4(n 


= 18) 


Total (n = 84) 


Scales M 


SD 


M 


SD 


M 


SD 


M 


SD 


M 


SD 


M 


SD 


Time Con- 3.58 


0.79 


3.70 


0.50 


3.83 


0.61 


3.63 


0.72 


3.26 


0.74 


3.59 


0.70 


suming 
























Effort 4.03 


0.84 


4.02 


0.47 


3.91 


0.55 


3.93 


0.71 


4.05 


0.53 


3.96 


0.63 



Table 7 

Attitude Toward Mathematics at Posttest by Condition 



Condition 




0 (n = 20) 


l(n = 17) 


2(n=17) 


3 (n= 12) 


4(n= 18) 


Total (n = 84) 


Scales 


M ^ 


M ^ 


M ^ 


M ^ 


M ^ 


M 




Ego 


2.86 0.83 


3.15 0.94 


2.86 0.76 


3.23 0.82 


3.18 0.92 


3.06 


0.86 


Task Ori- 


3.57 0.83 


3.47 0.71 


3.78 0.72 


3.40 0.76 


3.57 0.66 


3.55 


0.74 



entation 

Ctable continues) 
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Table 7, continued 



Condition 




0(n 


= 20) 


1(S 


= 17) 


2 (n 


= 17) 


3(n 


= 12) 


4(n 


= 18) 


Total (n = 84) 


Scales 


M 




M 




M 




M 




M 




M 


SD 


Work 


2.47 


0.88 


3.17 


1.04 


2.85 


0.92 


2.88 


1.09 


2.93 


1.00 


2.86 


1.00 


Avoidance 


























Interest 


3.92 


0.89 


4.13 


0.50 


4.23 


0.53 


3.78 


0.72 


4.07 


0.97 


4.02 


0.76 


Under- 


3.64 


0.80 


3.90 


0.63 


4.03 


0.52 


3.86 


0.60 


4.13 


0.57 


3.91 


0.65 


standing 


























Competi- 


2.92 


0.69 


2.97 


0.77 


2.78 


0.72 


3.25 


0.55 


2.81 


1.15 


2.95 


0.80 


tion 


























Ability 


3.63 


0.90 


3.95 


0.56 


3.88 


0.58 


3.68 


0.87 


3.72 


0.63 


3.77 


0.73 


Challenge 


3.22 


0.95 


3.30 


0.81 


3.11 


0.97 


2.84 


1.00 


3.06 


0.92 


3.11 


0.93 


Anxiety 


3.07 


0.74 


2.59 


0.82 


2.54 


0.75 


2.90 


0.88 


3.07 


0.70 


2.85 


0.80 


Utility 


3.98 


0.74 


3.99 


0.68 


3.87 


0.76 


3.85 


0.66 


3.89 


0.77 


3.92 


0.71 


Time Con- 


3.56 


0.73 


3.65 


0.65 


3.63 


0.79 


3.45 


0.77 


3.33 


0.80 


3.52 


0.75 


suming 


























Effort 


3.88 


0.89 


4.02 


0.55 


3.90 


0.55 


4.04 


0.62 


4.06 


0.56 


3.98 


0.65 
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Table 8 



Average Computer Game Attitude Scale f CPAS') Scores by Condition 



Condition 


M. 


sn 


Control 


2.75 


.44 


High-Contextual Advisor, No Competition 


2.76 


.41 


High-Contextual Advisor, Competition 


2.90 


.34 


Low-Contextual Advisor, No Competition 


2.30 


.58 


Low-Contextual Advisor, Competition 


2.86 


.39 


Total 


2.74 


.45 



Table 9 

Transfer Scores of Participants by Condition 



Condition 


Successful Transfer (n / %) 


Control 


10 (50%) 


High-Contextual Advisement, No Competition 


9 (53%) 


High-Contextual Advisement, Competition 


13 (77%) 


Low-Contextual Advisement, No Competition 


9 (75%) 


Low-Contextual Advisement, Competition 


11 (61%) 
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For all analyses that examined transfer as a dependent variable, only those 
participants who had completed the game (i.e., had not been forced to quit the game 
because of a computer problem or who had not accidentally exited the game prior to 
completing the problems) were included. This was done to control for differences in 
treatment time. This resulted in 16 participants not being included for analyses involving 
transfer. Table 10 presents the number excluded by condition. 

Of those that were excluded, none had answered the first or second problem. Only 
one had used advisement (once) prior to exiting the game, and participants were evenly 
split between males and females. No other discemable characteristics appeared to 
differentiate these participants from those included in the analysis. Table 1 1 presents 
other characteristics of these participants in more detail. 

Table 10 

Participants Excluded from Analyses Involving Transfer bv Condition 



Condition n 

1 (High-contextual advisement without competition) 1 

2 (High-contextual advisement with competition) 3 

3 (Low-contextual advisement without competition) 7 

4 (Low-contextual advisement with competition) 5 
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Null Hypotheses 
Null Hypothesis 2 



Null Hypothesis 2: Participants who use advisement more often than others will 
not differ in attitude toward mathematics scores. 

Regressions of the transformed advisor use variable on attitude towards mathematics as 
measured by the Math Beliefs Survey after posttest indicated that advisor use accounts 
for approximately 17% of the variance on the work avoidance scale and for 9% of the 
variance on the effort scale (n = 56, F = 10.81, p = .002, r^ = .167; n = 56, F = 4.912, p = 
.031, i = .085). This null hypothesis was not supported and the alternative hypothesis, 
that those who use advisement would have more positive attitudes toward mathematics, 
received support. 

A follow-up one-way ANOVA was conducted because the work avoidance scale 
appeared to be related to advisement use and because participants in the competition 
conditions were able to select from three levels of difficulty represented by the math 
ability of their competitor: good at math, average at math, not very good at math. There 
were no significant differences in work avoidance scores by level of competitor chosen. 

Null Hypothesis 3: Participants in the high-contextual advisement conditions will 
not differ from participants in the low-contextual advisement conditions in terms of 
advisement use. 

This hypothesis was examined concurrently with null hypotheses 7 and 14 in a 2 x 
2 ANOVA using the transformed (square root) advisor use variable as the dependent 
variable and competition and context of advisement as the independent variables. A main 
effect for context of advisement was significant, F (3, 60) = 10.26, MSE = .812, p = 
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.002). Participants in the competitive conditions used advisement less than those in the 
non-competitive conditions. Participants in the high-contextual advisement conditions 
selected advisement more often than those in the low-contextual advisement conditions. 
Caution must be used when interpreting the means as they represent the square root of the 
actual scores. This null hypothesis was not supported, and the alternative hypothesis, that 
those in the high-contextual advisement conditions would select advisement more often 
than those in the low-contextual advisement conditions, was supported. Tables 12 and 13 
present these results in more detail. For the purposes of interpretation, the ANOVA was 
run with the untransformed advisor use variable with the same results. Participants in the 
non-competitive conditions used advisement an average of 2.4 times more than those in 
the competitive conditions, while those in the high-contextual advisement conditions 
used advisement an average of 3.2 times more than those in the low-contextual 
advisement conditions. Tables 14 and 15 present these data in more detail. 

Table 12 

ANOVA Table of Competition by Context of Advisement on the Transformed Advisor 
Use Variable 



Source 


df 


F 


Competition 


1 


5.44* 


Context of Advisement 


1 


10.26** 


Competition x Context 


1 


.153 


of Advisement 







*g< .05 **g< .01 
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Table 13 



Means. Standard Deviations, and Numbers of Advisor Use by Conditions from ANOVA 
in Table 12 



Independent Variable 


M 


SD 


n 


Comnetition: 


Competition 


1.76 


.91 


36 


No Competition 


2.43 


.17 


29 


Context of Advisement: 


High-Contextual Advisement 


2.38 


.18 


35 


Low-Contextual Advisement 


1.68 


.16 


30 



Table 14 

ANOVA Table of Competition bv Context of Advisement on the Untransformed Advisor 
Use Variable 



Source 


df 


F 


Competition 


1 


5.87* 


Context of Advisement 


1 


11.32** 


MlxCA 


1 


.765 


error 


61 


(13.214) 



*E< 05 
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Table 15 



Means, Standard Deviations, and Numbers of Advisor Use by Conditions from ANOVA 
in Table 14 



Independent Variable 


Mean 


SD 


n 


ComDetition: 


Competition 


4.14 


3.47 


36 


No Competition 


6.69 


4.38 


29 


Context of Advisement: 


High-Contextual Advisement 


6.74 


4.5 


35 


Low-Contextual Advisement 


3.57 


2.7 


30 
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Null Hypothesis 5 



Null Hypothesis 5: Participants in the high-contextual advisement conditions will not 
differ from participants in the low-contextual advisement conditions in terms of attitude 
toward mathematics scores. 

Because attitude toward mathematics was measured by twelve subscales of the 
Math Beliefs Survey , a multivariate approach was required. Running these analyses 
separately ran the risk of an inflated Type I error, so a bonferoni approach was used. To 
use a standard alpha of .05 would have resulted in too conservative a test, however (p 
values would have to have been .004 for significance). Accordingly, the overall 
experimental alpha for all twelve analyses was raised to . 1 5 and a bonferoni approach 
was then used as recommended by Huberty and Morris (1989), resulting in p values of 
.01 or less being significant. 

Null hypothesis 5 was examined concurrently with null hypotheses 9 and 14 using 
a mixed model MANOVA with one within-subjects factor (pretest mathematics beliefs 
versus posttest mathematics beliefs) and two-between subjects factors (competition and 
context of advisement). Results are discussed separately. 

This MANOVA indicated that only the anxiety subscale showed a significant 
change from pre- to posttest mathematics beliefs, (F = 6.99, p = .01). Specifically, 
participants in the high-contextual advisement condition had lower scores on the anxiety 
subscale, 12.77, than those in the low-contextual advisement condition, 15.23. Null 
hypothesis 5 was not supported and the alternative hypothesis, that high-contextual 
advisement will result in a more positive attitude toward mathematics, was supported. 
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Null Hypothesis 6 



Null Hypothesis 6: Participants in the high-contextual advisement conditions will not 
differ from participants in the low-contextual advisement conditions in terms of attitude 
toward the computer game. 

Null hypothesis 6 was examined concurrently with null hypotheses 10 and 15 in a 
2x2 ANOVA with competition and high-contextual advisement as the independent 
variables and scores on the Computer Game Attitude Scale as the dependent variable. A 
main effect for context of advisement was found, F (3, 75) = 5.26, MSE = 487.03, p = 
.025). Specifically, participants in the high-contextual advisement conditions rated the 
game higher, 57.01, than participants in the low-contextual advisement, 52.02. Null 
hypothesis 6 was not supported and the alternative hypothesis, that high-contextual 
advisement would lead to higher ratings of the game, was supported. 

Null Hypothesis 8 

Null Hypothesis 8: Participants in the non-competitive simulation game conditions will 
not differ from those in the competitive simulation game conditions in terms of 
advisement use. 

This hypothesis was examined concurrently with null hypotheses 3 and 16 in a 2 x 
2 ANOVA using the transformed (square root) advisor use variable as the dependent 
variable and competition and context of advisement as the independent variables. A main 
effect for competition was significant, F (3, 60) = 10.26, MSE = 4.417, p = .002. 
Participants in the competitive simulation game condition used advisement less than 
participants in the non-competitive simulation condition. Caution must be used when 
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BEST COPY AVAIUBLE 



interpreting the means as they represent the square root of the actual scores. For the 
purposes of comparison, this analysis was also run on the untransformed advisor use 
variable with the same results, F (3, 61) = 5.872, MSE = 77.592, g = .001. This null 
hypothesis was not supported, and the alternative hypothesis, that those in the 
competitive simulation game conditions would select advisement less often than 
participants in the non-competitive simulation game conditions, was supported. Tables 
12, 13, 14, and 15 present these results in more detail. 

Null Hypothesis 1 3 

Null Hypothesis 13: There will be no interaction of context of advisement and 
competition on transfer of mathematics scores. 

This hypothesis was examined concurrently with null hypotheses 4 and 7 using a 
2x2 ANOVA. This analysis indicated no significant interaction of competition and 
context of advisement. A similar 2X2 ANOVA post-hoc analysis was run using a 
transfer score based solely on the ability to complete the problems in the game correctly. 
Because participants were not required to select formulae, it was felt that those who 
chose correct formulae may have done so by chance or for some other unforeseen reason. 
Likewise, those who selected incorrect formulae may have realized they had done so but 
not bothered to then select the correct formula, choosing instead to work the calculations 
on their scratch paper. Finally, in addition to transfer, this measure reflects problem 
solving, which is the most authentic assessment of transfer possible. Levene’s test of 
equality of error variances was significant, indicating the error variance of the dependent 
variable was not equal across groups. The cell numbers were large and equal (see Table 



O 

ERIC 



46 



13). This analysis yielded a significant interaction of competition and context of 
advisement, F (3, 60) = 4.528, MSB = 3.024, p = .037 (see Table 18 and Figure 1). This 
hypothesis was not supported, and there was no alternate hypothesis proposed. 



Table 18 

ANOVA Table of Competition and Context of Advisement on Transfer Score 





df 


F 


Significance 


Competition 


1 


.178 


.674 


Context 


1 


.414 


.522 


Interaction 


1 


4.528 


.037 




Figure 1. Interaction of competition and context of advisement on transfer of 
mathematics score. 
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Participants in the high-contextual advisement non-competitive condition had higher 
transfer of mathematics scores than participants in the low-contextual advisement 
competitive condition. Participants in the low-contextual advisement competitive 
condition had higher transfer of mathematics scores than those in the non-competitive 
conditions. No other differences were detected between or among the other conditions. 
To test whether pretest performance was responsible for any transfer effects, a chi-square 
of the two problems relating to area and perimeter in the posttest and in the game was 
conducted. There were no significant relationships between pretest and posttest scores on 
area and perimeter. No significant correlations were found between overall transfer 
scores and overall pretest scores, either. Finally, a regression of pretest scores on posttest 
transfer scores also failed to yield any significant predictive relationship. 
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DISCUSSION 



Hypotheses 
Hypothesis I 

Hypothesis I : Participants who use advisement more often than others will have 
higher transfer of mathematics scores. 

Findings 

This hypothesis was not supported. Participants who selected advisement more 
often than others were no more likely to have higher transfer of mathematics scores than 
were any other participants. 

Discussion 

Advisement in this question was measured by the number of times the participants 
selected either the high-contextual advisement (video-based) or the reference book. It is 
important to remember that participants in the contextualized advisement conditions had 
access to both the video-based advisement and the reference book of facts and formulae, 
while those in the low-contextual advisement conditions only had access to the reference 
book. Transfer was measured in a different context, at a different time, using different 
problems. The transfer variable ranges from 0 to 2, which may not allow for enough 
variability to detect differences, at least with this number of participants. Additional 
research is needed over a longer period of time in order to allow for more transfer items 
and more practice opportunities. Also, the advisement itself was not piloted and evaluated 
using participants to determine if the advisement is effective in reformulating the problem 
space. 
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Hypothesis 2 



Hypothesis 2: Participants who use advisement more often than others will have 
more positive attitude toward mathematics scores. 

Findings 

This hypothesis was supported. Advisor use accounted for approximately 17% of 
the variance in the work avoidance scale and the effort scale of the Math Beliefs Survey . 
Discussion 

Work avoidance measures the affective response to not having to work hard, 
working easy problems, not being asked to answer difficult questions, and so on. As 
such, a high score on this scale indicates that the respondent prefers not to work hard in 
mathematics. This may be due to a lack (or a perceived lack) of success in mathematics; 
learners would then be happiest when they are not called upon to do what they caimot (or 
believe they caimot) easily do. It may also be the result of not enjoying or liking 
mathematics, and therefore not being as willing to work as hard on it. In either case, one 
might expect that learners who score higher on this scale might be more inclined to seek 
help (i.e., advisement), either because they cannot solve the problem on their own or are 
not willing to solve it on their own. 

The effort scale measures the belief that success in mathematics is proportional to 
the amount of effort put forth by the individual. Those who score high on this scale 
would tend to believe that if they work hard, they will get/do better in mathematics. It is 
conceivable that advisement use might reflect this belief as well in that advisement 
seeking might be considered being thorough and showing effortful by such learners. In 
other words, it could be that the advisor is perceived as an extra source of information 
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and learning, and that advisement should be explored and utilized if one wants to 
improve. 

Hypothesis 3 

Hypothesis 3 : Participants in the high-contextual advisement conditions will use 
advisement more often than participants in the low-contextual conditions. 

Findings 

This hypothesis was supported. Participants in the high-contextual advisement 
conditions selected advisement more often than those in the low-contextual advisement. 
Discussion 

While this result may be partially related to mere presence of more advisement options in 
the contextual advisement conditions, it probably does not account for it entirely. The 
competitive and non-competitive conditions of the simulation game were structured in 
such a way that the reference book would have to be used equally in both contextual and 
low-contextual advisement conditions. The video-based advisement was comprised of the 
aunt and uncle discussing one or more aspects of the paint or wallpaper border problems. 
For example, they mention that the room is shaped like a rectangle if you look down on it 
from top, commenting that all that is needed a formula for calculating how far around it is 
around a rectangle. In no instance does the video provide the relevant formula. 
Accordingly, unless the learner has the relevant formula memorized, they would have to 
go to the book to look it up. While this prompt might double their advisement count for 
the first attempt, one would presume that the learner would quickly realize that the book 
has the formulae, and that there is no need to go to the video advisement unless 
something in the video advisement itself is of some use to them. Also, in order to get the 
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relevant work spaces to show up in their workbook page (where learners calculate and 
submit their answers) they must go to the reference book and click on the formulas and 
facts they want to use. While it is possible to submit answers without doing this, to do so 
would require that they perform all calculations and representations in their heads or on 
the provided scratch paper. 

It is also possible that high-contextual advisement resulted in higher advisement 
use because of the novelty effect of the video. Such results have been found and 
hypothesized in other research using multimedia-based instruction (e.g., Litchfield, 

1993). If this were the case, however, one would expect that the novelty effect would be 
at least partially ameliorated by the presence of competition. Because of the time penalty 
involved with finishing after the competitor, one might expect the learners to be less 
likely to select advisement solely for its novelty. 

A more likely explanation seems to be that the content of the advisement provided some 
instructional benefit. It is also possible that the presence of “human,” and teacher-like 
elements mimics typical problem solving strategies (e.g., when we get stuck on a 
problem, we ask someone for help). There is some support for this in the literature (e.g.. 
Gale, 1990). 

It is also interesting to note that although, as mentioned earlier, participants tended not to 
choose advisement, this was not an unconscious choice on their part. When asked about 
their help seeking strategies, most of the respondents indicated they had used the 
reference book. This is as expected, since the reference book was available to all 
participants. The second most common response was that they had not sought help. Just 
as with transfer, the difference between successful and unsuccessful help seeking may be 
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as simple as a prompt to seek help. An adaptive advisement system that offers help or 
simply prompts the learner to use the help system could go a long way toward increasing 
help seeking. Figure 2 presents participant responses regarding help seeking in the game. 



Figure 2 . Participant response to the question, “How did you get help in the game?” 



0 Didn't Get Help/By 
Thinking 
Q Calculator 

□ Friend/ Teacher 

□ Video Advisors 
■ Tape Measure 

□ Reference Book 
B Instructions 



Hypothesis 4 

Hypothesis 4; Participants in the high-contextual advisement conditions will have 
higher transfer of mathematics scores than those in the low-contextual advisement 
conditions. 

Findings 

This hypothesis was partially supported. When transfer was measured solely by 
the participants’ ability to solve the problem correctly, statistical analysis indicated that 
those in the high-contextual advisement conditions had higher transfer of mathematics 
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scores than those in the low-contextual advisement conditions. This only occurred in the 
simulation condition. There was no significant difference in transfer of mathematics 
scores between high-contextual advisement and low-contextual advisement conditions 
under the competitive condition, although those in the competitive, low-contextual 
advisement condition of the simulation game scored higher on the transfer task than did 
those in the non-competitive, low-contextual advisement, condition. 

Discussion 

The initial analysis, which measured transfer both as the ability to select correct 
formulae for the given problem and the ability to solve the problem correctly, did not 
yield any support for this hypothesis. The most logical conclusion is that transfer and 
context of advisement are not related. Upon further consideration, an alternate 
explanation suggests itself, however. Transfer can be seen as a form of problem solving; 
much of the research on transfer uses problem solving and problem-solving contexts. 
Given the close relation of transfer and problem solving, and given that one of the goals 
in this study is to promote “real world” (i.e., authentic) transfer, measuring transfer by the 
ability to select the correct formula and not also by the ability to app ly the formula 
correctly may result in only half the picture. When transfer was measured in this study as 
the ability to solve the problems correctly, a different picture emerged. High-contextual 
advisement in the simulation condition produced the highest transfer of mathematics 
scores of all the groups, indicating that it may be best suited for simulations. An 
argument could be made that such a definition is not truly transfer. Given that many 
researchers suggest that transfer be taught in problem-solving contexts over many 
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sessions, however, it seems reasonable to assume that successful problem solving is an 
indicator of future transfer, assuming enough practice opportunities. 

On this assumption, some analysis and interpretation of this result is warranted. It 
may be that the presence of competition creates an affective environment in which high- 
contextual advisement cannot be fully attended to or processed because learners are 
concerned about the time they have taken (which is displayed on screen) and with beating 
the competitor. The competitor character in the simulation game is always visible at the 
bottom right of the screen and randomly comments on how he or she (the competitor) is 
doing on the problem. The stress level involved with waiting for the advisement video to 
finish playing may interfere with accurate processing of the information. This may 
account for why the low-contextualized advisement in the competitive simulation game 
condition resulted in higher transfer of mathematics scores than it did in the non- 
competitive simulation condition, since learners are in control of how much time they 
spend in the reference book and have less to attend to while competing. 

Hypothesis 5 

Hypothesis 5: Participants in the high-contextual advisement conditions will have 
more positive attitude toward mathematics. 

Findings 

This hypothesis was supported. Participants in the high-contextual advisement 
conditions had lower anxiety toward mathematics scores than did those in the low- 
contextual advisement conditions. 
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Discussion 



Although 12 subscales were used in the Math Beliefs Survey, only anxiety 
showed a significant change from pre- to posttest. These findings are consistent with 
earlier research (CTGV, 1992c) that found that experience with anchored instruction 
scenarios reduced math anxiety. Further analysis reveals that the initial mathematics 
attitude scores were high, indicating that there may not have been much room for change. 
The initial scores were all well above 3 on a 5 -point scale (see Tables 6 and 7). It should 
also be noted that attitudes and beliefs usually take many interventions over a long period 
of time before changes occur (Gagne et al., 1992). The intervention in this case may not 
have been long enough to produce measurable differences. The survey has also not been 
validated in its current form, and may therefore not be measuring some of the constructs 
accurately enough. Some subscales may need additional items before they are sensitive 
enough to detect the kind of changes we might expect from a short intervention such as in 
this study. 

Hypothesis 6 

Hypothesis 6: Participants in the high-contextual advisement conditions will have 
more positive attitude toward the computer game scores than participants in the low- 
contextual advisement conditions. 

Findings 

This hypothesis was supported. Participants in the high-contextual advisement 
conditions had higher game rating scores than did those in the low-contextual advisement 
conditions. 
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Discussion 



It appears that high-contextual advisement can promote positive attitude toward 
the instruction. Such effects can in turn promote similar effects on the content as well. It 
may be that high-contextual advisement increases what Csikszentmihalyi (1990) calls 
flow-like experiences. The more immersive, or flow-like, a game is, the more 
intrinsically motivating it should be, thus leading to higher ratings of the game. It may 
also be that the presence of a socializing agent (the humans in the video) makes the 
learners more comfortable. 

Hypothesis 7 

Hypothesis 7 : Participants in the non-competitive simulation game conditions will 
have higher transfer of mathematics scores than participants in the competitive simulation 
game conditions. 

Findings 

This hypothesis was not supported. Participants in the non-competitive simulation 
game condition did best when they had access to high-contextual advisement. 

Participants in the competitive simulation game condition did best on transfer tasks when 
they had access to low-contextual advisement. 

Discussion 

It appears that advisement should be modified according to whether competition 
is present or not. Games that make use of a time element may be incompatible with high- 
contextual advisement, which by its nature takes longer and may be perceived as less 
relevant. Alternatively, it may be that time constraints and competition may be better 
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suited for building fluency and automaticity than for learning relatively new material and 
processes, as the transfer problems in this study might well be considered. 

Further research examining competition and cooperative learning might also help 
to explain these results, as some researchers maintain that cooperative learning is best for 
promoting problem-based learning and transfer (Bransford & Stein, 1993; Dalton, 
Haimafin, & Hooper, 1989; Reid, 1992; Young, 1993). 

Interestingly enough, most participants reported enjoying the competitive 
conditions, and that they were trying to beat the competitor. It may be that just as learners 
prefer control but are often unable to use it wisely, enjoyment may not reflect 
effectiveness of learning. Of those who did not enjoy competing, the majority cited that it 
was hard or confusing as their reason. Figures 3, 4, and 5 represent participant responses 
about competing in the game. 

Hypothesis 8 

Hypothesis 8: Participants in the non-competitive simulation game conditions will 
use advisement more often than participants in the competitive simulation game 
conditions. 
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Figure 3 . Participant response to the question, “If you played against another 
player, did you like that feature of the game?” 




Figure 4 . Participant response to the question, “Why or why not?” as a follow up to the 
question listed in Figure 3. 
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Figure 5. Participant response to the question, “Were you trying to beat [the 
competitor]?” 

Findings 

This hypothesis was supported. Participants in the non-competitive simulation game 
conditions used advisement more than those in the competitive simulation game 
conditions. 

Discussion 

The presence of competition and the time factor may have worked against 
advisement use in the non-competitive simulation game. As the learners in the 
competitive simulation game conditions are working, they are reminded at random 
intervals that they are competing against someone who is trying to finish faster than 
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them. This is accomplished by playing recorded comments by the competitor chosen for 
the non-competitive simulation game. These comments take such forms as “Aha! Now I 
get it!” and “ITl have this problem solved in no time!” This may prompt the learner to 
want to move quickly through the simulation game, something that is at odds with 
selecting advisement often, especially if that advisement is video-based and must be 
allowed to play to completion before any other action can be taken. 

Hypothesis 9 

Hypothesis 9: Participants in the non-competitive simulation game conditions will 
have more positive attitude toward mathematics than those in the competitive simulation 
game conditions. 

Findings 

This hypothesis was not supported. There were no differences by competition in 
attitude toward mathematics. 

Discussion 

It was hypothesized that the presence of competition would work against attitude 
toward mathematics. In retrospect, however, these results may not be so surprising. In 
respect to the attitude toward mathematics scores, we are faced with the same concerns 
discussed in hypothesis 5, namely, that the initial mathematics attitude scores were high 
enough to create a ceiling effect, that the scales may not be sensitive enough, and that the 
duration of the intervention was not long enough to produce a detectable difference. 
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Hypothesis 10 

Hypothesis 10: Participants in the non-competitive simulation game conditions 
will have more positive attitude toward the computer game scores than those in the 
competitive simulation game conditions. 

Findings 

This hypothesis was not supported. There were no differences by competition in 
attitude toward the computer game. 

Discussion 

It was hypothesized that the presence of competition would work against attitude 
toward mathematics and toward the instruction. In retrospect, however, these results may 
not be so surprising. Whether or not competition would impact attitude toward the 
content or the instruction may simply be a matter of whether one prefers competition or 
not. Certainly games with and without competition sell well enough in stores to suggest 
that many people enjoy one or the other. If preferences for competitive simulation games 
is normally distributed in the population, we might expect the results found in this study, 
assuming of course that our sample is representative. 

Hypothesis 11 

Hypothesis 1 1 : Participants in the competitive and non-competitive simulation 
game conditions will have higher transfer of mathematics scores than participants in the 
control conditions. 

Findings 

This hypothesis was not supported. No differences in transfer were found between 
the control conditions and the combined competitive and non-competitive conditions. 
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Discussion 



Given that there were no differences in transfer of mathematics scores solely as a result 
of either competition or context of advisement, it is perhaps not so surprising that 
controls did not differ from the other conditions. Controls had lower transfer scores than 
any other conditions, with a mean transfer score of .1335, while the transfer of 
mathematics scores for the other conditions ranged from .25 to .82. It may be that the 
measure of transfer in this study does not vary enough to detect differences because of a 
restriction of range. Transfer of mathematics scores ranged from 0 to 2, as they were 
based on the ability to select and apply the correct formulas for two problems. This was 
necessary because the intervention was limited by the schools to one 50-minute session, 
and situated learning is complex and requires elaborate processing; more than two 
problems could not have been finished by the learners in the allotted time. 

Hypothesis 12 

Hypothesis 12: Participants in the competitive and non-competitive simulation 
game conditions will have more positive attitude toward mathematics scores than 
participants in the control condition. 

Findings 

This hypothesis was not supported. No differences in attitude toward mathematics 
were found between those in the control conditions and those in the experimental 
conditions. 

Discussion 

The differences in attitude toward mathematics found in the earlier analyses, 
namely high-contextual advisement resulting in lower anxiety, and advisement use 




63 



66 



predicting scores on the work avoidance and effort scales, may not have been robust 
enough to remain detectable when mixed with the error terms of the other conditions. The 
previously stated concerns about the scale, intervention time, and high initial attitude 
scores are also relevant here. 

Time on Task. Time in Advisement 

Findings 

Two 2X2 ANOVAs of competition and context of advisement on time on task 
and time spent during advisement indicated main effects for context. Participants in the 
low-contextual advisement conditions spent 42 seconds longer on task than did 
participants in the high-contextual advisement conditions (F = 9.815, p = .003). 
Participants in the high-contextual advisement conditions spent 42 seconds longer in 
advisement than on task. 

Discussion 

These differences may have little practical significance in the given context. 
Forty-two seconds longer on task is unlikely to produce much gain given the complexity 
of the problems. Forty-two seconds longer in advisement, where it might be expected that 
participants are elaborating on the strategies, rules, and concepts needed to complete the 
problems, could be practically significant. It should be noted, however, that the extra time 
in the high-contextual advisement is probably related to the extra video advisement 
available as well as to the length of time it takes for that video to complete. 
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Limitations 



There are several factors that limit the internal and external validity of this study. 
It is important to keep these factors in mind when interpreting the results. What follows is 
a brief summary of these factors. 

Instruments 

The demographic survey (19 questions), pretest (26 questions), and Math Beliefs 
Survey (56 questions) had a combined length of 101 questions. Given that most of the 
questions required significant thought and processing, it may be that participants became 
tired of answering questions. Without fail, five or six people in each class made some 
comment to the experimenter regarding the length of these materials (e.g., “How many 
more of these questions are there?”). 

The Math Beliefs Survey has not been validated in its current form. It may not be 
sensitive enough to detect differences on all constructs, especially given the short 
duration of the intervention (50 minutes). Some scales may not have had enough items 
for reliable measurement. Scales ranged from two (n = 3) to seven (n = 1) questions, with 
a mode of three. Tables 19 and 20 present this data in more detail. Triangulation using 
personal interviews and other qualitative tools would make judgements about math 
beliefs more reliable and powerful. 
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Table 19 



Number of Questions by Each of the First 6 Subscales on the Math Beliefs Survey 



Ego 


Task 

Orientation 


Work Interest Understanding 

Avoidance 


Competitive 


n 4 


6 


3 2 3 


3 


Table 20 

Number of Questions bv Each of the Last 6 Subscales on the Math Beliefs Survev 




Ability 


Challenge 


Anxiety Utility Time Consuming 


Effort 


n 6 


7 


5 6 5 


6 



Some of the questions may not have been fully understood by the participants, as 
well. Without exception, participants in every class during the pilot (30), field trial (75), 
and the sample used in this study (123) asked what the word “relevance” meant. It may 
be possible that there were other words they did not know or know well enough, but 
which they did not ask about. Many participants commented that “It keeps asking me the 
same thing over and over again.” Many of the questions in the instrument are rephrased 
and asked again as an reliability check, but it could also be the case that some questions 
from different scales may have appeared quite similar to a seventh- or eighth-grade 
student. If students thought they were answering the same question that appeared earlier 
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in the instrument, they might have put the same answer down; they might have answered 
differently if they’d known it was a different question. 

The advisement itself was not validated for effectiveness with problem solving, 
although most of those asked indicated that the advisement was helpful (see Figures 6 & 
7). A pilot study to evaluate the effectiveness of the advisement would have made the 
study stronger. This study also did not examine qualitative measures regarding 
advisement. Debriefing forms asking about the qualitative aspects and affective responses 
to the instruction were distributed and collected, but return rate was low. 




Figure 6 . Participant response to the question, “Was the advisement/help in the game 
good?” 
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Figure 7 . Participant response to the question, “Did the advisement/help in the game help 
you figure out what to do?” 



Prerequisites. Training, and Prior Knowledge 
The mathematics content of the simulation and game focused on solving two 
problems: one requiring area and the other requiring perimeter. These topics were 
selected because they are well suited to the game scenario. The target population was 
seventh- and eighth-grade students. This population was selected based on consultation 
with teachers at middle schools, mathematics textbooks in use in local public middle 
schools, and a K-12 curriculum expert at a Gulf Coast university. It was commonly 
agreed that students begin to study area and perimeter in the fifth grade, and continue to 
study it through the year in sixth grade. It was felt that by the time they got to seventh and 
eighth grade, they should be familiar enough with the concepts that they could be 
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expected to work with these problems in the simulation/game format. Some problems 
were found with this assumption just prior to the study. While all participants were in 
seventh- and eighth-grade, some were in semi-remedial classes and were still working 
with these problems, while some others were in advanced mathematics classes. Because 
participants were randomly assigned, ability was controlled for throughout the conditions, 
but this did introduce some potential error into the statistical analyses. It would have been 
better to train the learners to mastery in the content, and then run the intervention weeks 
or months later. 

There was not enough time available for the learners to work at their own pace. 
The school required that all sessions take place with intact classes, during the regular 50- 
minute class periods. As a result, some participants were unable to complete the game, 
and most had little time for reflection and processing, focusing instead on getting the 
work done in the allotted time. Those who did not finish the game were excluded from 
the analyses to minimize error. This may have resulted in an overly conservative test for 
differences among groups. It also created disparity in cell sizes, although the ratio of 
included-to-missing cases was better than 90/10. The fidelity of the treatment condition 
would have been higher had students been able to work at their own pace over a longer 
period of time. That there was not enough time for the participants to process all the 
information is borne out by their responses when asked how the game could be improved; 
the most common response was “more instructions and help.” Figure 8 presents all their 
responses by category. 
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M Design Issues/ Technical 
Problems 
m Confusing 

□ Better/More 
Instructions/Help 

□ Make It Easier 

■ Nothing-Game Is Good 

B Allow Picking Wallpaper & 
Paint 

B Make It More Fun 
B Needs Music 



Figure 8 . Participant response to the question, “What didn't you like about the game? 
What would have made it better?” 
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Variables 

There were some variables that made inferential statistics difficult to run and/or 
interpret. The Math Beliefs Survey scores may not be uniformly reliable given the low 
number of items (2) on three of them (work avoidance, interest, and anxiety). As a result, 
these scales might not have produced valid scores. It should be noted, however, that the 
items in question are among the more stable and powerful constructs from the earlier test, 
(with approximate alphas of .87, .71, and .80 from the original factor analysis) and it is 
felt that these scales are stable enough to support fewer items. 

Because there was not enough time to do more than two problems, transfer of 
mathematics scores had a restricted range, potentially leading to low variance and 
validity for this variable. Advisement use was negatively skewed and kurtotic. There is 
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good reason to believe that this is the case in the population, as it has been shown that 
novice learners do not select advisement unless they are prompted (Dempsey & Van Eck, 
1998). There were no prompts in the game beyond the initial game instructions to use the 
walkie-talkie to call for advice if they got stuck. However, it was felt that this variable 
should be transformed by taking the square root. When the statistical test for competition 
and context of advisement was run on the transfer scores using the untransformed 
advisement use variable, a significant interaction was found. This stands in stark contrast 
to the significant main effects found when using the transformed variable. Without more 
concrete data on this particular population and advisement use, it is not possible to say 
which variable or interpretation should be accepted. Because ANOVA assumes normal 
distribution (although it is robust to violations of this assumption), the transformed 
variable was used in the final analysis. 

Population 

The target population for this study is seventh- and eighth-grade students at 
Catholic middle schools. The sample selected was drawn from both seventh- and eighth- 
grade mathematics classes at a single school in a Gulf Coast city. External 
generalizability is therefore limited to this population. Originally, three public schools 
with differing standardized test scores were identified for inclusion in the study. One of 
these schools was unable to participate at the last minute and an alternate date was 
unavailable. A second school did not have a computer lab set up and had to use 10 laptop 
computers that required set up each session. This reduced the number of participants by a 
factor of one half. A pep rally was called during the second session of this school as well, 
and the data collection was suspended. No alternate dates could be found. The third 



school reported having 20 Pentium computers in a lab, but in reality had 6 Pentium 
computers and fourteen 486 computers running Windows 3.1 . Additional computers were 
located in teachers’ rooms and in the library, and data were collected in both places, but 
this also reduced the number of participants run and the time each participant had to 
complete the sessions. A pep rally was also scheduled for this school at the last minute, 
and five hours of data collection were lost during the game session. Some participants 
were rescheduled, but not all could complete the study. This also introduced a time factor 
that could possibly have introduced error. For this reason, the data in this study reflects 
only the Catholic school data despite having the data from 75 participants at the other 
school. Data are not available on whether or not the sample used in this study is 
representative of Catholic middle schools nationwide, let alone public schools. 
Replications with other schools and locations are needed before generalizability beyond 
the current sample is possible. 

Design 

Good interface design dictates that items and tools should be a logical extension 
of the metaphor being used. In this case, the metaphor is a room that is being 
remodeled/redecorated. Accordingly, advisement was selected by clicking on a reference 
book (low-contextual advisement) or clicking on either the reference book and/or a 
walkie-talkie (high contextual advisement). In order to allow the learners to move about 
the room to measure and collect information, it was necessary to give the tools as small a 
“footprint” as possible. While this did not prevent users from finding or using 
advisement, it may not have been as obvious as prior research has suggested it should be 
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(Dempsey & Van Eck, 1998). Consequently, advisement may not have been selected as 
often as it might otherwise have been. 

Although participants had all received at least one year of training in the content, 
no external criteria of mastery was available. The study would have been stronger if it 
had been possible to provide training to mastery prior to the intervention. Finally, transfer 
and attitude change may require longer periods of time and multiple practice and 
interventions (Gagne et al., 1992; Larkin, 1989). The intervention was limited in this 
study because the schools could only provide three class days out of their normal 
curriculum. The instruments required one class period on their own up front, leaving one 
session for the game and one session for the posttest. More interventions over a longer 
period of time for longer periods of time and the inclusion of qualitative measures may 
have produced larger changes. 

Because participants were able to type in their answer to either of the two transfer 
problems in the game and in the posttest without doing any calculations on screen and 
without selecting any formulae or facts, it is possible some participants entered answers 
that amounted to guesses. It was not possible to determine with any accuracy whether 
participants were guessing at the answers because some may have used their scratch 
paper to do the calculations. While this scratch paper was retained by the researcher, it is 
problematic to evaluate these sheets for this purpose. A few participants left without 
fil min g in their scratch paper. Some participants may have done some or all of their 
calculations in their heads; while that is not likely to result in a correct response, there is 
no way to evaluate the effort and mental calculations that went into their answers. 

Finally, while some participants may have guessed, all students spent the full 50-minute 
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session actively engaged in the game and the solution to the problems. Some may have 
ended up putting down what amounts to a guess but did so after a sustained period of 
effort. No participants entered their answers early in the session. 

Conclusions 

Bearing in mind the considerations discussed in the preceding section it is 
appropriate to discuss what conclusions may be drawn from this study. This section will 
present summaries of the major conclusions in this study. 

Transfer 

Transfer can be promoted through computer-mediated intervention. One of the 
factors associated with increased transfer of mathematics scores seems to be whether and 
to what extent the learners avail themselves of advisement. Instruction that attempts to 
build in advisement should also explore ways to promote its use; presence alone is not 
enough. 

Attitude and Advisement Use 

Attitude toward mathematics and toward mathematics instruction may be 
increased through modified advisement use. This, again, requires not only the presence of 
advisement but ways to promote its use. Measures of work avoidance and effort seemed 
to be partially predicted by advisement use in general. 

Promoting Advisement Use 

Advisement use may be promoted by simulations rather than by games. 
Simulations, through the absence of competition involving time pressure, may encourage 
exploration and experimentation in the environment. Such exploration might naturally 
include selecting advisement. 
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Advisement can also be promoted by making the advisement an interesting, 
metaphorical part of the context in which it occurs. This is more than a novelty effect, as 
high-contextual advisement resulted in higher advisement use even under competitive 
conditions, which were found to result in lower advisement use than under the simulation 
conditions. 

Context of Advisement and Transfer 

Contextual advisement can promote transfer under non-competitive conditions. 
High-contextual advisement in non-competitive conditions produced the highest transfer 
of mathematics scores. This is probably a function both of the newness of the instruction 
and of the complexity of the instruction as much as it is a function of the competition. 
Transfer is a form of problem solving, which is in this case a higher-order intellectual 
skill involving accurate problem space representation, recall of prior knowledge, and the 
formulation of rules about when and where to apply that knowledge. Accordingly, the 
cognitive load involved may be higher than for lower-level intellectual skills. 

Competition may create an affective state of anxiety and pressure that is detrimental to 
the processing necessary for transfer learning to occur. There were no detectable 
differences between high-contextual and low-contextual advisement conditions in the 
competitive simulation game condition. 

Context of Advisement and Mathematics Anxiety 
Contextual advisement may decrease anxiety toward mathematics. Building high- 
contextual advisement into simulations or games may help lower mathematics anxiety. 
This may be the result of the humanizing features of the video, the conversation help with 
problem representation, or both. 




75 



78 



Context of Advisement Versus Competition on Attitude 

Contextual advisement may increase positive attitude toward the instruction 
independent of the competition. High-contextual advisement seems to be a more 
important consideration than is competition. This may be due partially to the novelty 
effect of built-in video in a computer context. 

Summary 

In summary, for transfer training of this nature, non-competitive simulation games 
might be the best choice, better at least than simulation games that include a time- 
pressure factor. Advisement seems to be a good way to promote transfer and positive 
attitude toward mathematics and the instruction, the latter two of which can indirectly 
promote future performance. High-contextual advisement, that is, advisement that is 
metaphorically tied to the context in which it is found and is interesting, may be the best 
form of advisement. This is true regardless of the presence or absence of competition but 
perhaps particularly so for non-competitive simulation games. It tends to promote 
advisement use, which in turn is associated with transfer and attitude toward 
mathematics. Finally, simulation games seem to be capable of representing authentic 
contexts, with and without competition, and may be useful in promoting transfer in a 
variety of subject areas. 

Future Research 

This study is intended to be generative in nature rather than definitive and should 
be replicated and expanded upon by others in the field of learning theory and 
instructional design. While this study has answered some questions, it has raised others. 
Taken in conjunction with previous studies on advisement (e.g., Boulet, 1993; Boulet et 
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BEST COPY AVAILABLE 



al., 1990; Dempsey & Van Eck, 1998; Tennyson, 1980a, 1980b, 1981) it would seem that 
advisement can help learners manage their own instruction, increase performance, and 
promote transfer. The issue may no longer be if advisement is necessary, but why it is, 
and how its use can be promoted. High-contextual advisement increased advisement use, 
as did the absence of competition. Studies should examine other ways to promote 
advisement in simulations and games. An earlier study showed that making the 
advisement option obvious on the screen can increase advisement use (Dempsey & Van 
Eck, 1998), but this may be contraindicated in simulations and games, where a premium 
is placed on the immersive quality of the experience. It may be possible to build a kind of 
adaptive advisement system similar to that developed by Tennyson (1980a, 1980b), but 
which sends contextual prompts to the learner (e.g., after three errors and/or long periods 
of inactivity, voices come over the walkie-talkie asking if they need any help). A similar 
form of advisement has been utilized in a game called Hangtown (Doolittle, 1995). 

Questions and Variables 

Further research is needed to determine which factors of the high-contextual 
advisement used in this study are responsible for the effects observed. High-contextual 
advisement could be delivered by sound only with no loss in contextual relevance. This 
would help to determine what kinds of novelty or modality effects may be at work. The 
observed decrease in anxiety may be due to the contexuality of the advisement or to the 
humanizing presence of the aunt and uncle characters. One might use similar video clips 
of people but make them generic advisors, unconnected to the context of the simulation 
or game. 
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Competition may inhibit elaboration. Future research might examine the role 
competition plays in elaborative processing. This should be done taking into account both 
time stress and competition as separate variables. While this study looked at competition 
as a factor, it might also be beneficial to examine cooperative learning in similar contexts. 
Research has shown that cooperative learning may be best for promoting transfer 
(Bransford & Stein, 1993; CTGV, 1992b; Keller, 1990; Young, 1993). 

Design 

Further research should consider a mixed methods approach, using think-aloud 
protocols, observational measures, and oral debriefing to begin to examine the why and 
how of the trends discussed in this study. Future research might also consider tracking 
errors and looking for patterns which might then be used to develop adaptive advisors. 
Future studies might also examine transfer issues in a more longitudinal fashion, perhaps 
over the course of one or more years. 

Contexts 

Gender 

Further research should be done to examine what kinds of gender differences 
there are in advisor preference and preference for competition. There was a 
participant/competitor gender effect; it may be reasonable to expect the same kind of 
relation between gender of participant and gender of advisor. It would be useful to 
examine whether this had any effect on advisor use, which was one of the more robust 
variables in this study. Such an effect might also impact affect as well. Future studies 
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might provide different gendered advisors and run conditions where gender of advisor 
and participant were crossed. 

Public Versus Private 

The population for this study are private Catholic school students. There may be a variety 
of cultural beliefs and attitudes in this population which might be expected to impact the 
variables in this study. Catholic school students may be less likely to be questioning of 
teachers, thereby leading to differences in advisement use. Private school students may be 
more advanced and have better problem-solving skills than public school students. 

Private school students may also have higher computing skills and abilities because 
computing technology is more prevalent in private than public schools. Public school 
populations should be studied in similar fashion to strengthen generalizability of results. 
Age 

The population under study was aged 12 to 14. The effectiveness of training and 
instruction using simulations and games should be studied at different age groups. 
Younger students exposed to this kind of training during instruction on the topic of 
interest, in this case area and perimeter, might be more successful transferring knowledge 
than those in this study, who were exposed after having studied the content exclusively in 
the abstract. 




79 



82 



REFERENCES 



Adams, L. T., Kasserman, J. E., Yearwood, A. A., Perfetto, G. A., Bransford, J. 
D., & Franks, J. J. (1988). Memory access: The effects of fact-oriented versus problem- 
oriented acquisition. Memory and Cognition. 16 (2). 167-175. 

Allen, J. R. (1972). Current trends in computer-assisted instruction. Computers 
and the Humanities. 7 . 47-55. 

Allen, L. E., & Ross, J. (1977). Improving skill in applying mathematical ideas: A 
preliminary report on the instructional gaming program at Pelham Middle School in 
Detroit. The Alberta Journal of Educational Research. 23 . 257-267. 

Allington, R. L., & Strange, M. (1977). The problem with reading games. The 
Reading Teacher. 31 (3). 272-274. 

Anderson, J. R. (1995). Cognitive psychology and its implications (4* ed.). New 
York: W. H. Freeman. 

Anderson, J. R., Reder, L. M., & Simon, H. A. (1996). Applications and 
misapplications of cognitive psychology to mathematics education 111 . Unpublished 
paper, retrieved May 7, 1996, from the World Wide Web: 
http://act.psy.cmu.edu/ACT/papers/misapplied-abs-ja.html 

Asch, S. E. (1969). A reformulation of the problem of associations. American 
Psychologist. 24 . 92-102. 

Atkinson, J. W., & O’Connor, P. (1963). Effects of ability grouping in schools 
related to individual differences in achievement-related motivation (Report No. CRP- 
1283; Report No. D4615-1-F). Cooperative Research Program of The Office of 




80 



83 



Education, U. S. Department of Health, Education, and Welfare, Washington, DC. (ERIC 
Document Reproduction Service No. ED 003249) 

Baltra, A. (1990). Language learning through computer adventure games. 
Simulation and Gaming. 21 (4). 445-452. 

Bandura, A. (1977). Self-efFicacy: Toward a unifying theory of behavioral 
change. Psychological Review. 84 12'). 191-215. 

Barak, A., Engle, C., Katzir, L., & Fisher, W. A. (1987). Increasing the level of 
empathic understanding by means of a game. Simulation and Games. 18 (4). 458-470. 

Bardwell, R. (1984). The development and motivational function of expectations. 
American Educational Research Journal. 21 (2). 461-472. 

Barling, J., & Beattie, R. (1983). Self-efficacy beliefs and sales performance. 
Journal of Organizational Behavior Management. 5. 41-51. 

Becker, H. J. (1991). How computers are used in United States schools; Basic 
data from the 1989 1. E. A. computers in education survey. Journal of Educational 
Computing Research. 7 (4). 385-406. 

Becker, H. J. (1999). Internet use bv teachers: Conditions of professional use and teacher- 
directed student use . (Teaching, learning, and computing: 1998 national survey. Report 
No. 1, pp. 1-35). Center for Research on Information Technology and Organizations, 
University of California, Irvine, and the University of Minnesota. 

Becker, H. J., & Sterling, C. (1987). Equity in school computer use: National data 
and neglected considerations. Journal of Educational Computing Research, 3 . 289-311. 
Begg, 1., & White, P. (1985). Encoding specificity in interpersonal communication. 
Canadian Journal of Psychology. 39 11). 70-87. 




81 



84 - 



Bermettt, K. (1992). The use of on-line guidance, representation, aiding, and 
discovery learning to improve the effectiveness of simulation training. In J. W. Regian 
and V. J. Shute (Eds.), Cognitive approaches to automated instruction (217-244). 
Hillsdale, NJ: Erlbaum. 

Black, R. S., & Schell, J. W. (1995, December). Learning vyithin a situated 
cognition framevyork: Implications for adult learning . Paper presented at the annual 
meeting of the American Vocational Association, Denver, CO. (ERIC Document 
Reproduction Service No. ED 389 939) 

Bloom, B. S. (1984). The 2-sigma problem: The search for methods of group 
instruction as effective as one-to-one tutoring. Educational Researcher. 13 (6). 4-16. 

Boulet, M. M. (1993). Intelligent advisor systems and transfer of knowledge. In 
Verbal-visual literacy: Understanding and applying new educational communication 
media technologies . Selected readings from the Symposium of the International Visual 
Literacy Association, Delphi, Greece, June 25-29, 1993. (ERIC Document Reproduction 
Services No. ED 393 425) 

Boulet, M. M. (1994). Providing just-in time help to case tool users. Journal of 
Computing in Higher Education. 6 11 j. 44-62. 

Boulet, M. M., Barbeau, L., & Slobodrian, S. (1990). Advisor system: Conception 
of an intervention module. Computers and Education. 14 111. 17-29. 

Bower, G. H. (1981). Mood and memory. American Psychologist. 36 f2j. 129-148. 

Bower, G. H. (1987). Commentary on mood and memory. Behavior Research 
Therapy. 25 161. 443-455. 




82 



85 



Bransford, J. D., Franks, J. J., Vye, N. J., & Sherwood, R. D. (1989). New 
approaches to instruction; Because wisdom can’t be told. In S. Vosniadou & A. Ortany 



(Eds.), Similarity and analogical reasoning (pp. 470-497). New York: Cambridge 
University Press. 

Bransford, J. D., Sherwood, R. D., Hasselbring, T. S., Kinzer, C. K., & Williams, S. M. 
(1990). Anchored instruction: Why we need it and how technology can help. In D. Nix & 
R. Spiro (Eds.), Cognition, education, multimedia: Exploring ideas in high technology 
(pp. 115-141). Hillsdale, NJ: Erlbaum. 

Bransford, J., Sherwood, R., Vye, N., & Rieser, J. (1986). Teaching thinking and 
problem solving. American Psychologist. 41 110). 1078-1089. 

Bransford, J. D., & Stein, B. S. (1993). The ideal problem solver: A guide for 
improving thinking, learning, and creativity . (2"‘' ed.). New York: W. H. Freeman. 

Brerman, R. (1998, March 15). Interactive entertainment industry growing faster 
than U. S. economy. Game Week. 4 151. 1. 

Bright, G. W., Harvey, J. G., & Wheeler, M. M. (1985). Learning and 
mathematics games. Journal for Research in Mathematics Education. Monograph 
Number 1 . 

Brophy, J. (1987). Synthesis of research on strategies for motivating students to 
learn. Educational Leadership. 45 (2). 40-48. 

Brown, A. L. (1989). Analogical learning and transfer: What develops? In S. 
Vosniadou & A. Ortony (Eds.), Similarity and analogical reasoning (pp. 369-413). 
Cambridge, MA: Cambridge University Press. 




83 



86 



Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture 
of learning. Educational Researcher. 18 . 32-42. 

Brownfield, S., & Vik, G. (1983). Teaching basic skills with computer games. 
Training and Development Journal. 37 (12'). 272-274. 

Burton, R. R., & Brown, J. S. (1982). An investigation of computer coaching for 
informal learning activities. In Intelligent tutoring systems (pp. 79-98). London: 
Academic Press: Computers and people series. 

Butler, R., & Nisan, M. (1986). Effects of no feedback, task-related comments, 
and grades on intrinsic motivation and performance. Journal of Educational Psychology. 
78(3), 210-216. 

Butler, R. J., Markulis, P. M., & Strang, D. R. (1988). Where are we? An analysis 
of the methods and focus of the research on simulation gaming. Simulation and Games. 
19(1), 3-26. 

Campanizzi, J. A. (1978). Effects of locus of control and provision of overviews 
in a computer-assisted instruction sequence. Association of Educational Data Systems 
Journal, n ni. 21-30. 

Carlson, J. G., & Hill, K. D. (1982). The effect of gaming on attendance and 
attitude. Persormel Psychology. 35 . 63-73. 

Carrier, C. (1984). Do learners make good choices? Instructional Irmovator. 

29(2), 15-17, 48. 

Cartmill, C. (1994). Cognitive performance in women as influenced by gender- 
role identity, competition conditions, and task difficulty (Doctoral dissertation, California 



84 



ERIC 




School of Professional Psychology, 1994). Dissertation Abstracts International. 55('02') . 
627B. 

Chappell, K. K., & Taylor, C. S. (1997). Evidence for the reliability and factorial 
validity of the Computer Game Attitude Scale . Journal of Educational Computing 
Research. 17 m. 67-77. 

Choi, J. I. (1995). The effects of contextualization and complexity of situation on 
mathematics problem-solving and attitudes. (Doctoral dissertation, Florida State 
University, 1995). Dissertation Abstracts International. 561101. 3884A. (UMI Microform 
No. 9605031) 

Choi, J. I., & Hannafm, M. (1995). Situated cognition and learning environments: 
Roles, structures, and implications for design. Educational Technology Research and 
Development. 43 ( 2 ). 53-69. 

Christel, M. G. (1994). The role of visual fidelity in computer-based instruction. 
Human-Computer Interaction. 9. 183-223. 

Clariana, R. B. (1989). Computer simulations of laboratory experiences. Journal 
of Computers in Mathematics and Science Teaching. 8 12'). 14-19. 

Clariana, R. B. (1993). The motivational effect of advisement on attendance and 
achievement in computer-based instruction. Journal of Computer-Based Instruction. 
20(2), 47-51. 

Clark, M. S., Milberg, S., & Ross, J. (1983). Arousal cues arousal-related material 
in memory: Implications for understanding effects of mood on memory. Journal of 
Verbal Learning and Verbal Behavior. 22. 633-649. 




85 



88 



Cognition and Technology Group at Vanderbilt. (1990). Anchored instruction and 
its relationship to situated cognition. Educational Researcher. 10 ('6~). 2-10. 

Cognition and Technology Group at Vanderbilt. (1991). Technology and the 
design of generative learning environments. Educational Technology. 31 (5). 34-40. 

Cognition and Technology Group at Vanderbilt. (1992a). An anchored instruction 
approach to cognitive skill acquisition and intelligent tutoring. In J. W. Regian and V. J. 
Shute (Eds.), Cognitive approaches to automated instruction (pp. 135-170). Hillsdale, NJ: 
Erlbaum. 

Cognition and Technology Group at Vanderbilt. (1992b). The Jasper experiment: 
An exploration of issues in learning and instructional design. Educational Technology 
Research and Development. 40 1 11. 65-80. 

Cognition and Technology Group at Vanderbilt. (1992c). The Jasper series as an 
example of anchored instruction: Theory, program description, and assessment data. 
Educational Psychologist. 27 ('3~). 291-315. 

Cognition and Technology Group at Vanderbilt. (1993). Anchored instruction and 
situated cognition revisited. Educational Technology. 33 ('3~). 52-70. 

Cognition and Technology Group at Vanderbilt. (1996). Multimedia 
environments for enhancing learning in mathematics. In S. Vosniadou, E. De Corte, R. 
Glaser, & H. Mandl (Eds.), International perspectives on the design of technology- 
su pported learning environments (pp. 285-305). Mahwah, NJ: Erlbaum. 

Cognition and Technology Group at Vanderbilt. (1997). The Jasper Project: 
Lessons in curriculum, instruction, assessment. & professional development . Mahwah, 
NJ: Erlbaum. 




86 



Cohen, R. B., & Bradley, R. H. (1978). Simulation games, learning, and retention. 
The Elementary School Journal. 78 14'). 247-253. 

Cohen, R., & Siegel, A. W. (1991). A context for context: Toward an analysis of 
context and development. In R. Cohen & A. W. Siegel (Eds.), Context and development 
(pp. 3-23). Hillsdale, NJ: Erlbaum. 

Coleman, J. S. (1989). Simulation games and the development of social theory. 
Simulation and Games. 20 (21. 144-164. 

Collins, A., Brown, J. S., & Newman, S. E. (1989). Cognitive apprenticeship: 
Teaching the crafts of reading, writing, and mathematics. In L. B. Resnick (Ed.), 
Knowine. learning, and instruction: Essays in honor of Robert Glaser (pp. 453-494). 
Hillsdale, NJ: Erlbaum. 

Craig, G. J. (1967). The effect of distribution of rewards, grade level, and 
achievement level on small group applicational problem solving (Doctoral dissertation. 
University of Massachusetts, 1967). Dissertation Abstracts International. 28(09). 3894B. 
(University Microfilms, No. 68-2755) 

Crawford, C. (1982). The art of computer game design . Out-of-print book 
retrieved August 31, 1998, from the World Wide Web: 
http://www.vancouver.wsu.edU/fac/peabody//game-book/Coverpage.html 

Cruickshank, D. R., & Telfer, R. (1980). Classroom games and simulations. 
Theory into Practice. 19 11'). 75-80. 

Csikszentmihalyi, M. (1990). Flow: The psychology of optimum experience . New 
York: Harper Perennial. 




87 



90 



Dalton, D. W., Hannafm, M. J., & Hooper, S. (1989). Effects of individual and 
cooperative computer-assisted instruction on student performance and attitudes. 
Educational Technology Research and Development. 37 12'). 15-24. 

Damarin, S. K. (1994). The emancipatory potential of situated learning. 
Educational Technology, 34 18'). 16-22. 

Davies, G. M. (1988). Faces and places: Laboratory research on context and face 
recognition. In G. M. Davies & D. M. Thomson (Eds.), Memory in context: Context in 
memory (pp. 35-53). Chichester, England: Wiley. 

Dempsey, J. V., Lucassen, B., Gilley, W., & Rasmussen, K. (1993). Since 
Malone's theory of intrinsically motivating instruction: What's the score in gaming 
literature? Journal of Educational Technology Systems. 22 ( 2 ). 173-183. 

Dempsey, J. V., Lucassen, B. A., Haynes, L. L., & Casey, M. S. (1997, February). 
Computer games: An exploratory study . Paper presented at the aimual meeting of the 
Association for Educational Communications and Technology, Albuquerque, NM. 

Dempsey, J. V., Tucker, S. A., & Jacobs, J. (1990, April). Attention reduction 
training: Overview and implications for training and research . Paper presented at the 
annual meeting of the American Educational Research Association, Boston, MA. 

Dempsey, J. V., & Van Eck, R. N. (1998, April). Advisor use in CBT : Modality 
and placement . Paper presented at the annual meeting of the American Educational 
Research Association, San Diego, CA. 

DeVries, D. L., & Slavin, R. E. (1976). Teams - games - tournament: A final 
report on the research (Report No. 217). Baltimore, MD: Johns Hopkins University. 




88 



91 



Center for the Study of Social Organization of Schools. (ERIC Document Reproduction 
Service No. ED 133 315) 

Doolittle, J. H. (1995). Using riddles and interactive computer games to teach problem- 
solving skills. Teaching of Psychology. 22 11'). 33-36. 

Doyle, D. P. (1992). The challenge, the opportunity. Phi Delta Kappan. 73 17'). 512-520. 
Driskell, J. E., & Dwyer, D. J. (1984). Microcomputer videogame based training. 
Educational Technology. 24 12'). 11-16. 

Druckman, D. (1995). The educational effectiveness of interactive games. In D. 
Crookall & K. Arai (Eds.), Simulation and gaming across disciplines and cultures (pp. 
178-187). Thousand Oaks, CA: Sage. 

Duchastel, P. (1991). Instructional strategies for simulation-based learning. 
Journal of Educational Technology Systems. 19 13'). 265-276. 

Duin, A. H. (1988). Computer-assisted instructional displays: Effects on students’ 
computing behaviors, prewriting, and attitudes. Journal of Computer-Based Instruction. 
15(2), 48-56. 

Egerton, J. (1966). Academic games: Play as you learn. Southern Education 
Report. March-April . 2-7 

Ertmer, P. A., & Newby, T. J. (1993). Behaviorism, cognitivism, constructivism: 
Comparing critical features from an instructional design perspective. Performance 
Improvement Quarterly. 6 ( 4 ) 50-72. 

Faria, A. J. (1987). A survey of the use of business games in academia and 
business. Simulation and Games. 18 12'). 207-224. 




89 



92 



Fennema, E., & Sherman, J. (1976). Fennema- Sherman mathematics attitude 
scales: Instruments designed to measure attitudes towards the learning of mathematics by 
males and females. Catalog of Selected Documents in Psvcholoev. 6 . 31-32. 

Fernandez, A., & Glenberg, A. M. (1985). Changing environmental context does 
not reliably affect memory. Memory & Cognition. 13(4) . 333-345 

Festinger, L. (1954). A theory of social comparison processes. Human Relations. 
7, 117-140. 

Fingar, P. (1999, April). Intelligent agents: The key to open ecommerce. 
Component Strategies . 29-35. 

Fisher, J. E. (1976). Competition and gaming: An experimental study. Simulation 
& Games. 7 131. 321-328. 

Fisher, M. D., Blackwell, L. R., Garcia, A. B., & Greene, J. C. (1975). Effects of 
student control and choice on engagement in a CAl arithmetic task in a low-income 
school. Journal of Educational Psychology. 67 ('6'1. 776-783. 

Fry, J. P. (1972). Interactive relationship between inquisitiveness and student 
control of instruction. Journal of Educational Psychology. 63 ('5'). 459-465. 

Gagne, R. M. (1965). The conditions of learning . New York: Holt, Rinehart, and 
Winston. 

Gagne, R. M., Briggs, L. J., & Wager, W. W. (1992). Principles of instructional 
design (4* ed.). Fort Worth, TX: Harcourt Brace Jovanovich. 

Gal, 1., & Ginsburg, L. (1994). The role of beliefs and attitudes in learning 
statistics: Towards an assessment framework. Journal of Statistics Education. 2 ( 2 ). 1-18. 



Gale, S. (1990). Human aspects of interactive multimedia communication. 
Interacting with Computers. 2 ( 2 ). 175-189. 

Gayeski, D. M. (1989). Why information technologies fail. Educational 
Technology. 29 ( 2 ). 9-17. 

Gayeski, D. M. (1994). Multimedia systems in education. In The international 
encyclopedia of education (Vol. 7, pp. 3991-3996). Tarrytown, NY: Elsevier Science. 

Geiselman, R. E., & Glenny, J. (1977). Effects of imagining speakers’ voices on 
the retention of words presented visually. Memory and Cognition. 5 15). 499-504. 

Gick, M. L., & Holyoak, K. J. (1980). Analogical problem solving. Cognitive 
Psychology, 12. 306-355. 

Gildea, P. M., Miller, G. A., & Wrutenberg, C. L. (1990). Contextual enrichment 
by videodisc. In D. Nix & R. Spiro (Eds.), Cognition, education, and multimedia (pp. 1- 
29). Hillsdale, NJ: Erlbaum. 

Godden, D. R., & Baddeley, A. D. (1975). Context-dependent memory in two 
natural environments: On land and underwater. British Journal of Psychology, 66 (3). 
325-331. 

Goodman, D. A., & Crouch, J. (1978). Effects of competition on learning. 
Improving College and University Teaching. 26 12). 130-133. 

Graesser, A. C., & Magliano, J. P. (1991). Context and cognition. In R. Cohen & 
A. W. Siegel (Eds.), Context and development (pp. 57-76). Hillsdale, NJ: Erlbaum. 

Gray, D. M. (1988). The use and effect on performance of learner control and 
advisement in a computer-based educational statistics lesson (Doctoral dissertation. 




91 



94 



University of Illinois at Urbana-Champaign, 1988). Dissertation Abstracts International. 
491061 . 1434A. 

Gredler, M. (1994). Designing and evaluating games and simulations: A process 
approach . Houston, TX: Gulf Publishing. 

Greenblat, C. S. (1973). Teaching with simulation games. Teaching Sociology. 
i(l), 62-83. 

Greene, D., & Lepper, M. R. (1974). Effects of extrinsic rewards on children’s 
subsequent intrinsic interest. Child Development. 45 . 1 141-1 145. 

Griffin, M. M. (1995). You can’t get there from here: Situated learning, transfer, 
and map skills. Contemporary Educational Psychology. 20 . 65-87. 

Gruver, H. L. (1968). School mathematics contests: A report . Washington, DC: 
National Council of Teachers of Mathematics. (ERIC Document Reproduction Service 
No. ED 034 692) 

Hannafm, M. J., & Peck, K. L. (1988). The design, development, and evaluation 
of instructional software . New York: MacMillan. 

Harley, S. (1993). Situated learning and classroom instruction. Educational 
Technology. 33 13'). 46-5 1 . 

Hativa, N. (1989). Student conceptions of, and attitudes toward, specific features 
of a CAI system. Journal of Computer-Based Instruction. 16 (3). 81-89. 

Hayes, J. R. (1989). The complete problem solver (2"‘^ ed.). Hillsdale, NJ: 
Erlbaum. 




92 



95 



Hayes, J. R., & Simon, H. A. (1977). Psychological differences among problem 
isomorphs. In N. J. Castellan, Jr., D. B. Pisoni, & G. R. Potts (Eds.), Cognitive theory 
(Vol. 2, pp. 21-41). Hillsdale, NJ: Erlbaum. 

Heckman, P. E., & Weissglass, J. (1994). Contextualized mathematics instruction: 
Moving beyond recent proposals. For the Learning of Mathematics 140) 29-33. 

Heyman, M. 0982V What are simulation games? Environmental Education 
Report (Vol. 10, No. 5, pp. 1-5). Washington, DC: Center for Environmental Education. 

Hidi, S., & Baird, W. (1986). Interestingness— a neglected variable in discourse 
processing. Cognitive Science. 10 . 179-194. 

Homer, M. S. (1968). Sex differences in achievement, motivation and performance in 
competitive and noncompetitive situations (Doctoral dissertation. University of 
Michigan, 1968). Dissertation Abstracts International. 30 (01). 407B. 

Homer, M. S. (1972). Toward an understanding of achievement-related conflicts 
in women. Journal of Social Issues. 28 (2). 157-176. 

Huberty, C. J., & Morris, J. D. (1989). Multivariate analysis versus multiple univariate 
analyses. Psychological Bulletin. 105 ('2V 302-308. 

Hughes, L. A. (1988). “But that’s not really mean”: Competing in a cooperative 
mode. Sex Roles. 19 (1 1/12), 669-687. 

Hurlock, E. B. (1927). The use of group rivalry as an incentive. Journal of 
Abnormal Social Psychology, 22. 278-90. 

Inkpen, K., Klawe, M., Lawry, J., Sedighian, K., Leroux, S., Hsu, D., Upitis, R., 
Anderson, A., & Ndunda, M. (1994). “We have never- forgetful flowers in our garden”: 



Girls’ responses to electronic games. Journal of Computers in Mathematics and Science 
Teaching. 13 (4'). 383-403. 



Jacobs, J. W., & Dempsey, J. V. (1993). Simulation and gaming: Fidelity, 
feedback, and motivation. In J. V. Dempsey & G. C. Sales (Eds.), Interactive instruction 
and feedback (pp. 197-227). Englewood Cliffs, NJ: Educational Technology 
Publications. 

Johansen, K. J., & Tennyson, R. D. (1983). Effect of adaptive advisement on 
perception in learner-controlled, computer-based instruction using a rule-learning task. 
Educational Communications and Technology Journal. 31 (4'). 226-236. 

Julian, J. W., & Perry, F. A. (1967). Cooperation contrasted with intra-group and 
inter-group competition. Sociometrv. 30 . 79-90. 

Keefer, J. A., & Karabenick, S. A. (1998). Help seeking in the information age. In 
Strategic help seeking: Implications for learning and teaching (pp. 219-250). Mahwah, 
NJ: Erlbaum. 

Keller, J. K. (1990). Characteristics of Logo instruction promoting transfer of 
learning: A research review. Journal of Research on Computing in Education. 23 (1'). 55- 
71. 

Kent, S. L. (1999, June 23) For military, games hone combat skills. USA Today. 

p. 2D. 

Kids watching the tube. (1997, November/December). Techniques. 72 (8). 7. 

Kiesler, S., Sproull, L., & Eccles, J. S. (1985). Pool halls, chips, and war games: 
Women in the culture of computing. Psychology of Women Quarterly. 9 (4'). 451-462. 




94 



97 



Kinzie, M. B. & Sullivan, H. J. (1989). Continuing motivation, learner control, and CAI. 
Educational Technolopv Research and Development. 37 (2), 5-14. 

Klawe, M., Westrom, M., Davidson, K., & Super, S. (1996). Phoenix Quest: 
Lessons in developing an educational computer game for girls . . . and boys . Paper 
presented at ICMTM96. Retrieved October 29, 1998, from the World Wide Web: 
http://www.cs.ubc.ca/nest/egems/papers.html 

Klein, J. D., & Freitag, E. (1991). Enhancing motivation using an instructional 
game. Journal of Instructional Psvcholoev. 18 (2). 111-117. 

Klein, J. D., Freitag, E., & Wolf, B. (1990, February). Providing practice using 
instructional gaming: A motivating alternative . Proceedings of selected paper 
presentations at the annual meeting of the Association for Educational Communications 
and Technology. (Eric Document Reproduction Service No. ED 323 936) 

Kloosterman, P., & Stage, F. K. (1992). Measuring beliefs about mathematical 
problem solving. School Science and Mathematics. 92 (3). 109-115. 

Kozma, R. B. (1991). Learning with media. Review of Educational Research. 61 (2), 179- 
211. 

Kraft Miller, J. L. (1981). Competition, maturation rate, and motive to avoid 
success in mathematics as predictors of performance on a spatial task (Doctoral 
dissertation. University of Washington, 1981). Dissertation Abstracts International, 
42{06}, 2602B. 

Kraiger, K., Ford, J. K., & Salas, E. (1993). Application of cognitive, skill-based, 
and affective theories of learning outcomes to new methods of training evaluation. 
Journal of Applied Psychology. 78 12~). 311-328. 




95 



98 



Kulik, J. A., Kulik, C. C., & Cohen, P. A. (1980). Effectiveness of computer- 
based college teaching: A meta-analysis of findings. Review of Educational Research. 
50(4), 525-544. 

Lancaster, D. R. (1988). The games computers play. Educational Resources and 
Techniques. 27 t'3V 29-31. 

Larkin, J. H. (1989). What kind of knowledge transfers? In L. B. Resnick (Ed.), 
Knowine. learning, and instruction: Essays in honor of Robert Glaser (pp. 283-305). 
Hillsdale, NJ: Erlbaum. 

Lave, J. (1988). Coenition in practice: Mind, mathematics, and culture in 
everyday life . New York: Cambridge University Press. 

Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral 
participation . Cambridge, MA: Cambridge University Press. 

Lawry, J., Upitis, R., Klawe, M., Anderson, A., Inkpen, K., Ndunda, M., Hsu, D., 
Leroux, S., & Sedighian, K. (1994). Exploring common conceptions about boys and 
electronic games. Journal of Computers in Mathematics and Science Teaching . Retrieved 
September, 1998, from the World Wide Web: 
http ://www.cs .ubc . ca/nest/egems/papers . html 

Lee, Y. B., & Lehman, J. D. (1993). Instructional cueing in hypermedia: A study 
with active and passive learners. Journal of Educational Multimedia and Hypermedia, 
2(10), 25-37. 

Lehman, C. H. (1987, April). The adult mathematics learner: Attitudes, 
expectations, attributions . Paper presented at the annual meeting of the American 




96 



Educational Research Association, Washington, DC. (ERIC Document Reproduction 
Service No. ED 283 680) 

Lent, R. W., Brown, S. D., & Larkin, K. E. (1984). Relation of self-efficacy 
expectations to academic achievement and persistence. Journal of Counseling Practice, 
31(3), 356-362. 

Lepper, M. R., & Chabay, R. W. (1985). Intrinsic motivation and instruction: 
Conflicting views on the role of motivational processes in computer-based education. 
Educational Psychologist. 20 (4). 217-230. 

Lepper, M. R., Greene, D., & Nisbett, R. E. (1973). Undermining children’s 
intrinsic interest with extrinsic reward: A test of the “overjustification” hypothesis. 

Journal of Personality and Social Psychology. 28 11'). 129-137. 

Lepper, M. R., & Milojkovic, J. D. (1986). The “computer revolution” in 
education: A research perspective. In P. F. Campbell & G. G. Fein (Eds.), Young 
children and microcomputers: Conceptualizing the issues . Englewood Cliffs, NJ: 
Prentice-Hall. 

Litchfield, B. C. (1993, April). Design factors in multimedia environments: 
Research findings and implications for instructional design . Paper presented at the annual 
meeting of the American Educational Research Association, Atlanta, GA. (ERIC 
Document Reproduction Service No. ED 363 268) 

Lockhart, R. S., Lamon, M., & Gick, M. L. (1987). Contextual transfer in simple 
insight problems. Memory and Cognition . 16(1), 36-44. 

Lopez, C. L. (1990, February). Personalizing math word problems . Proceedings of 
selected paper presentations at the convention of the Association for Educational 




97 

1^0 



Communications and Technology. (ERIC Document Reproduction Service No. ED 323 
939) 

Loyd, B. H., & Gressard, C. (1984). Reliability and factorial validity of computer 
attitude scales. Educational and Psychological Measurement. 44 (2), 501-505. 

Malone, T. W. (1981). Toward a theory of intrinsically motivating instruction. 
Cognitive Science. 4. 333-369. 

Malone, T. W., & Lepper, M. R. (1987). Making learning fun; A taxonomic 
model of intrinsic motivations for learning. In R. E. Snow & M. J. Farr (Eds.), Aptitude, 
learning, and instruction: III. Cognitive and affective process analysis (pp. 223-253). 
Hillsdale, NJ: Erlbaum. 

Malouf, D. B. (1987-88). The effect of instructional computer games on 
continuing student motivation. The Journal of Special Education. 21 (4), 27-38. 

Marsh, H. W., Cairns, L., Relich, J., Barnes, J., & Debus, R. L. (1984). The 
relationship between dimensions of self-attribution and dimension of self-concept. 
Journal of Educational Psychology, 76 (1). 3-32. 

Matlin, M. W. (1998). Cognition (A*' ed.). Fort Worth, TX: Harcourt Brace. 
Matlin, M. W., & Stang, D. J. (1978). The Pollvanna principle: Selectivity in language, 
memory, and thought . Cambridge, MA: Schenkman. 

McGrenere, J. (1996, June). Design: educational electronic multi-player games: A 
literature review . Technical Report 96-12, the University of British Columbia. Retrieved 
September, 1998, from the World Wide Web: 
http://www.cs.ubc.ca/nest/egems/papers.html 



98 



101 



McLellan, H. (1994). Situated learning: Continuing the conversation. Educational 



Technology. 34 18'). 7-8. 

Meacham, J. A., & Emont, N. C. (1989). The interpersonal basis of everyday 
problem solving. In J. D. Sinott (Ed.), Everyday problem solving: Theory and application 
(pp. 7-23). New York: Praeger. 

Milheim, W. D., & Azbell, J. W. (1988). How past research on learner control can 
aid in the design of interactive video materials. Proceedings of the 1 0^ Annual Meeting 
of the Association for Educational Communications and Technology . New Orleans, LA. 
(ERIC Document Reproduction Service No. ED 295 652) 

Miller, A. D., & Heward, W. L. (1992). Do your students really know their math 
facts? Using daily time trials to build fluency. Intervention in School and Clinic, 28 (2), 
98-104. 

Miller, G. A., & Gildea, P. M. (1987). How children learn words. Scientific 
American. 257 f3'l. 94-99. 

Moore, J. L., Xiaodong Lin, Schwartz, D. L., Petrosino, A., Hickey, D. T., 
Campbell, O., Hmelo, C., and the Cognitition and Technology Group at Vanderbilt. 
(1994). The relationship between situated cognition and anchored instruction: A response 
to Tripp. Educational Technology. 34 (10). 28-32. 

Morris, R., & Thomas, J. (1976). Simulation and training-part 1 . Industrial 
Training International. 1 i n'). 66-69. 

Negroponte, N. (1995). Being digital. New York: Alfred A. Knopf 

Newburger, E. C. (1999). Computer Use in the United States: 1997 . (Current 
Population Survey Report P20-522). U.S. Census Bureau, U.S. Department of 

99 



102 



Commerce, Economics and Statistics Administration. Retrieved April 1, 2000, from the 
World Wide Web: http://www.census.gov/population/www/socdemo/computer.html 

Newkirk, R. L. (1973). A comparison of learner control and machine control 
strategies for computer-assisted instruction. Programmed Learning and Educational 
Technology. lO QV 82-91. 

Nicholls, J., Cobb, P., Wood, T., Yackel, E., & Patashnick, M. (1990). Assessing 
students’ theories of success in mathematics: Individual and classroom differences. 
Journal for Research in Mathematics Education. 21 . 109-122. 

Niemiec, R., & Walberg, H. J. (1987). Comparative effects of computer-assisted 
instruction: A synthesis of reviews. Journal of Educational Computing Research. 3 11). 
19-37. 

Osgood, C. E. (1949). The similiarity paradox in human learning: A resolution. 
Psychological Review. 56 . 132-143. 

Park, O., & Tennyson, R. D. (1980). Adaptive design strategies for selecting 
number and presentation order of examples in coordinate concept acquisition. Journal of 
Educational Psychology. 73 . 745-753. 

Pascale, P. J. (1974). Evaluation report for project year 1 of “Relating 
Mathematics to the Middle School Child’s Real World.” Educational Psychology 
Measures. 34 14). 989-995. 

PBS: Life on the Internet: Timeline. (2000). Retrieved April 1, 2000, from the 
World Wide Web: http://www.pbs.org/intemet/timeline/timeline-txt.html 

Perfetto, G. A., Bransford, J. D., & Franks, J. J. (1983). Constraints on access in a 
problem solving context. Memory and Cognition, ll fl'). 24-31. 




100 



103 



Perkins, D. N., & Salomon, G. (1989). Are cognitive skills context-bound? 
Educational Researcher. 18('lk 16-25. 

Peters, C. L. (1988). The effects of advisement, content mapping, and interactive 
video on learner control and achievement in computer-based instruction (Doctoral 
dissertation. University of Georgia, 1988). Dissertation Abstracts International. SOQT 
348A. 

Phillips, E., & Klawe, M. (1995). Engaging children as collaborative researchers: 
A classroom study with electronic mathematical games. Unpublished paper retrieved 
September, 1998, from the World Wide Web: 
http://www.cs.ubc.ca/nest/egems/papers.html 

Pierfy, D. A. (1977). Comparative simulation game research. Simulation and 
Games. 8 r2E 255-268. 

Quinones, M. A., Sego, D. J., Ford, J. K., & Smith, E. M. (1995). The effects of 
individual and transfer environment characteristics on the opportunity to perform trained 
tasks. Training Research Journal. I f IT 29-49. 

Randel, J. M., Morris, B. A., Wetzel, C. D., & Whitehill, B. V. (1992). The 
effectiveness of games for educational purposes: A review of recent research. Simulation 
and Gaming. 23 (3). 261-276. 

Reed, S. K., Ernst, G. W., & Banerji, R. (1974). The role of analogy in transfer 
between similar problem states. Cognitive Psychology. 6 . 436-450. 

Reid, J. (1992). The effects of cooperative learning with intergroup competition 
on the math achievement of seventh grade students . (Research Report). (ERIC Document 
Reproduction Service No. ED 355 106). 



101 

104 



Reigeluth, C. M., & Schwartz, E. (1989). An instructional theory for the design of 
computer-based simulations. Journal of Computer-Based Instruction. 16 (1). 1-10. 

Reinking, D. P. (1983). The effects of computer mediated text on measures of 
reading comprehension and reading behavior (Doctoral dissertation. University of 
Minnesota, 1983). Dissertation Abstracts International. 44(1 1) , 3339A. 

Remmer, A. M., & Jemstedt, G. C. (1982). Comparative effectiveness of 
simulation games in secondary and college level instruction: A meta-analysis. 
Psychological Reports, 51 . 742. 

Rescue at Boone’s Meadow . (1997). [Computer software]. Nashville, TN: Cognition & 
Technology Group at Vanderbilt, Vanderbilt University: The Jasper Project: Lessons in 
curriculum, instruction, assessment, and professional development. 

Rieber, L. P. (1996). Seriously considering play: Designing interactive learning 
environments based on the blending of microworlds, simulations, and games. Educational 
Technology Research and Development. 44 (2). 43-58. 

Rogoff, B., & Gardner, W. (1984). Adult guidance of cognitive development. In B. 
Rogoff & J. Lave (Eds.), Everyday cognition: Its development in social context (pp. 95- 
1 16). Cambridge, MA: Harvard University Press. 

Royer, J. M. (1979). Theories of the transfer of learning. Educational Psychologist, 14 , 
53-69. 

Salomon, G., & Perkins, D. N. (1989). Rocky roads to transfer: Rethinking 
mechanisms of a neglected phenomenon. Educational Psychologist. 24 (2), 113-142. 




102 



105 



Santiago, R. S., & Okey, J. R. (1992). The effects of advisement and locus of 
control on achievement in learner-controlled instruction. Journal of Computer-Based 
Instruction. 19 (2'). 47-53. 

Saufley, W. H., Jr., Otaka, S. R., & Bavaresco, J. L. (1985). Context effects: 
Classroom tests and context independence. Memory and Cognition. 13 16'). 522-528. 

Schank, R. C. (1979). Interestingness: Controlling inferences. Artificial 
Intelligence. 12 . 273-297. 

Schoenfeld, A. H. (1983). Problem solving in the mathematics curriculum: A 
report, recommendations and an annotated bibliography (MAA Notes, No. 1). 
Washington, DC: The Mathematical Association of America. 

Schoenfeld, A. H. (1985). Mathematical problem solving . Orlando, FL: Academic 

Press. 

Schools and technology. (1997). Techniques. 72 (61. 11. 

Schuerman, R. L., & Peck, K. L. (1991). Pull-down menus, menu design, and 
usage patterns in computer-assisted instruction. Journal of Computer-Based Instruction. 
18(3), 93-98. 

Schulze, K. G. (1990). The use of multiple explanations in an open-ended 
intelligent tutoring system. Journal of Educational Technology Systems. 18 (3'). 235-243. 

Sedighian, K. (1997). Challenge-driven learning: A model for children's 
multimedia mathematics learning environments . Paper presented at ED-MEDIA 97: 
World Conference on Educational Multimedia and Hypermedia, Calgary, Canada. 
Retrieved September, 1998, from the World Wide Web: 
http://www.cs.ubc.ca/nest/egems/papers.html 

103 



106 



Sedighian, K. & Sedighian, A. S. (1996). Can educational computer games help 



educators learn about the psychology of learning mathematics in children? Paper 
presented at the 18th Annual Meeting of the International Group for the Psychology of 
Mathematics Education ~ the North American Chapter, Florida, USA. Retrieved 
September, 1998, from the World Wide Web: 
http://www.cs.ubc.ca/nest/egems/papers.html 

Seginer, R. (1980). Game ability and academic ability. Simulation & Games. 
n( 4 ), 403-421. 

Shaw, M. E., & Costanza, P. R. (1970). Theories of social psychology . New 
York, McGraw-Hill. 

Sherwood, R. D., & Cognition and Technology Group at Vanderbilt. (1991, April). The 
development and preliminary evaluation of anchored instruction environments for 
developing mathematical and scientific thinking . Paper presented at the annual meeting 
of the National Association for Research in Science Teaching, Lake Geneva, WI. 

Shoot video like a pro. (1995). [Computer software]. Pleasanton, CA: Red Hill Studios. 

Sierpinska, A. (1995). Mathematics: "In context," "pure," or "with applications"? 
For the Learning of Mathematics. 15 ('1I 2-15. 

Simon, H. A., & Hayes, J. R. (1976). The understanding process: Problem 
isomorphs. Cognitive Psychology. 8 ('2L 165-190. 

Smead, V. S., & Chase, C. I. (1981). Student expectations as they relate to 
achievement in eighth grade mathematics. Journal of Educational Research. 75 , 1 15-120. 



104 



107 



Smith, P. L. (1992, April). A model for selecting from supplantive and generative 



instructional strategies for problem-solving instmction . Paper presented at the annual 
meeting of the American Educational Research Association, San Francisco, CA. 

Smith, S. M. (1988). Environmental context-dependent memory. In G. M. Davies 
& D. M. Thomson (Eds.), Memory in context: Context in memory (pp. 13-34). 

Chichester, England: Wiley. 

Smith, S. M., Glenberg, A., & Bjork, R. A. (1978). Environmental context and 
human memory. Memory and Cognition. 6 (4'). 342-353. 

Snider, R. C. (1992, December). The machine in the classroom. Phi Delta Kappan, 316- 
323. 

Software for kids: More than fun and games. (1995, December). Consumer 
Reports. 60 (12'). 763-767. 

Soukhanov, A. H., et al. (1996). American heritage dictionary of the English 
language (3'^'* Ed.). Boston, MA: Houghton Mifflin. 

Spalt, S. K. (1988). The effects of academic competition upon school system support, 
teacher-sponsor operational behavior, secondary school curriculum and student 
performance on the American College Test (Doctoral Dissertation, Southern Illinois 
University at Carbondale, 1987. Dissertation Abstracts International. 48 ( 1 1). 2801A. 
Spivey, P. M. (1985). The effects of computer-assisted instmction on student 
achievement in addition and subtraction at first-grade level . Unpublished paper in support 
of educational specialist degree, Augusta College, GA. (ERIC Document Reproduction 
Service No. ED 263 874) 



105 



108 



Streibel, M. J. (1994). Misattributions about situated learning. Educational 



Technology. 34 ('8'). 14-16. 

Streitz, N. A. (1988). Mental models and metaphors: Implications for the design 
of adaptive user-system interfaces. In H. Mandl & A. Lesgold (Eds.), Learning issues for 
intelligent tutoring systems (pp. 164-186). New York: Springer-Verlag. 

Stumpf, S. A., Brief, A. P., & Hartman, K. (1987). Self-efficacy expectations and 
coping with career-related events. Journal of Vocational Behavior. 31 , 91-108. 

Sutton-Smith, B. (1997). The ambiguity of play . Cambridge, MA: Harvard 
University Press. 

Szczurek, M. (1982). Meta-analysis of simulation games effectiveness for 
cognitive learning (Doctoral dissertation, Indiana University, 1982). Dissertation 
Abstracts International. 43(041 . 1031A. 

Tennyson, R .D. (1980a, April). Advisement and management strategies as design 
variables in computer-assisted instruction . A paper presented at the annual meeting of the 
American Educational Research Association, Boston, MA. 

Tennyson, R.D. (1980b). Instructional control strategies and content structure as 
design variables in concept acquisition using computer-based instruction. Journal of 
Educational Psychology. 72 (4). 525-532. 

Tennyson, R. D. (1981). Use of adaptive information for advisement in learning 
concepts and rules using computer-assisted instruction. American Educational Research 
Journal, 18 (4). 425-438. 



106 

109 



Tennyson, R. D. (1984). Artificial intelligence methods in computer-based 
instructional design: The Minnesota Adaptive Instructional System. Journal of 
Instructional Development. y Gl. 17-22. 

Tennyson, R. D., & Buttrey, T. (1980). Advisement and management strategies as 
design variables in computer-assisted instruction. Educational Communications and 
Technology. 28 . 169-176. 

Tennyson, R. D., Christensen, D. L., & Park, S. 1. (1984). The Minnesota 
Adaptive Instructional System: An intelligent CBl system. Journal of Computer-Based 
Instruction, ll tl'l. 2-13. 

Tessmer, M., & Richey, R. C. (1997). The role of context in learning and 
instructional design. Educational Technology Research and Development. 45 ( 2 ). 85-115. 

Thompson, G. B. (1972). Effects of co-operation and competition on pupil 
learning. Educational Research. 15 (1'). 28-36. 

Thorndike, E. L. (1969). Individual differences and their causes (Volume 11 of 
Educational psychology, and originally published in 1903 as Educational psychologvl . 
New York: Amo Press and the New York Times: American education series. 

Thorndike, E. L., & Woodworth, R. S. (1901). The influence of improvement in 
one mental function upon the efficiency of other functions: 1, 11, & 111. Psychological 
Review. 8 13. 4, 6), 247-261, 384-395, 553-564. 

Thurman, R. A. (1993). Instmctional simulation from a cognitive psychology 
viewpoint. Educational Technology Research and Development. 41 (4'). 75-89. 

Thyne, J. M. (1963). The psychology of learning and techniques of teaching . 
London: University of London Press. 




107 



ito 



Tripp, S. D. (1993). Theories, traditions, and situated learning. Educational 



Technology. 33 131. 71-77. 

Van Haneghan, J. P. (1990). Third and fifth graders’ use of multiple standards of 
evaluation to detect errors in word problems. Journal of Educational Psychology, 82 12). 
352-358. 

Van Haneghan, J. P., Barron, L., Young, M. F., Williams, S. M., Vye, N. J., & 
Bransford, J. D. (1992). The Jasper series: An experiment with new ways to enhance 
mathematical thinking. In D. F. Halpem (Ed.), Enhancing thinking skills in the sciences 
and mathematics (pp. 15-38). Hillsdale, NJ: Erlbaum. 

Van Haneghan, J. P., & Hickey, D. (1993, March). Higher order analyses of 
children’s beliefs about mathematics . Poster session presented at the biennial meeting of 
the Society for Research in Child Development, New Orleans, LA. 

VanSickle, R. L. (1986). A quantitative review of research on instructional 
simulation gaming: A twenty-year perspective. Theory and Research in Social Education. 
20V(3), 245-264. 

Vye, N. J., Schwartz, D. L., Bransford, J. D., Barron, B. J., Zech, L., & the 
Cognition and Technology Group at Vanderbilt. (1998). SMART environments that 
support monitoring, reflection, and revision. In Metacognition in educational theory and 
practice (pp. 305-346). Mahwah, NJ: Erlbaum. 

Vygotsky, L. S. (1962). Thought and language . Cambridge, MA: The M. I. T. 

Press. 



108 



111 



Vygotsky, L. S. (1978). Mind in society: The development of higher 



psychological processes . (M. Cole, V. John-Steiner, S. Scribner, & E. Souberman, Eds.). 
Cambridge, MA; Harvard University Press. 

Watkins, M. W. (1986). Microcomputer-based mathematics instruction with first 
grade students. Computers in Human Behavior. 2 . 71-75. 

Waywood, A. (1992). Journal writing and learning mathematics. For the Learning of 
Mathematics. 12 (2). 34-43. 

Weinberg, R., Gould, D., & Jackson, A. (1979). Expectations and performance: 
An empirical test of Bandura’s self-efficacy theory. Journal of Sport Psychology, 1 . 320- 
331. 

Weisberg, R., DiCamillo, M., & Phillips, D. (1978). Transferring old associations 
to new situations: A nonautomatic process. Journal of Verbal Learning and Verbal 
Behavior. 17. 219-228. 

Westrom, M., Super, D. & Klawe, M. (1995) Design issues involving 
entertainment click-ons . CHI '95. Unpublished paper retrieved October 28, 1998, from 
the World Wide Web: http://www.cs.ubc.ca/nest/egems/papers.html 

Weusi-Puryear, M. (1975). An experiment to examine the pedagogical value of a 
computer simulated game designed to correct errors in arithmetical computations 
(Doctoral dissertation, Stanford University, 1975). Dissertation Abstracts International. 
36(04), 2005A-2006A. 

Wilkes, G. N. (1965). An experimental study of the effect of competition on the 
learning of a selected physical education activity skill (Doctoral dissertation, Peabody 




109 

1 12 



College for Teachers of Vanderbilt University, 1965). Dissertation Abstracts 
International. 27 ('041 . 1198B. 

Williams, R. H. (1980). Attitude change and simulation games: The ability of a 
simulation game to change attitudes when structured in accordance with either the 
cognitive dissonance or incentive models of attitude change. Simulation and Games. 
ii(2), 177-196. 

Willoughby, Bereiter, Hilton, & Rubinstein. (1985). Real math flevel 71 . LaSalle, 
IL: Open Court. 

Wood, D. (1997, Febmary 23) Computer age redefines war games for Marines. Mobile 
Register , p. A8. 

Wu, Y. C. (1992, November). Computerized teachers’ praise: Incorporating 
teachers’ images and voices . Paper presented at the annual meeting of the Mid-South 
Educational Research Association, Knoxville, TN. (ERIC Document Reproduction 
Service No. ED 354 873) 

Yang, Y. C. (1992). The effects of media on motivation and content recall: 
Comparison of computer- and print-based instmction. Journal of Educational Technology 
SystemSj_20(2), 95-105. 

Young, M. F. (1993). Instructional design for situated learning. Educational 
Technology Research and Development. 4K '!'). 43-58. 

Yu, F. Y. (1997). Competition or noncompetition: Its impact on interpersonal 
relationships in a computer-assisted learning environment. Journal of Educational 
Technology Systems. 25 (1'). 13-24. 




110 



113 



Zellermayer, M., Salomon, G., Globerson, T., & Givon, H. (1991). Enhancing 
writing-related metacognitions through a computerized writing partner. American 
Educational Research Journal. 28 (2). 373-391. 




Ill 

114 




U.S. Department of Education 

Office of Educatonai Research artd Improvement (OERI) 
National Library of Education (NLE) 

Educational Resources Information Center (ERIC) 

REPRODUCTION RELEASE 

(Specific Document) 

I. DOCUMENT IDENTIFICATION: 









Title: 



• ( Kifi 

q’<^V/l%qr \J Ct.Vvc)' 1^vVOV-(3 ^ClUv-eV»^c^lcS 

;r— — ; ^ i uMO f Q’siWt G~<>t^f <g 

Author(s): y<\dWc.rd> U 



Corporate Source: 



Publication Date: 



II. REPRODUCTION RELEASE: 

monthly abs^'^wn^ ^ irnnmtil^n? <f«»"nent8 announced in the 

and lectmnic mSTand «>ld 

reproduction release Is granted, one of the following notices te to the ^ajironP^ ‘ ” ® * ^ “** 



I affixed to the document 

of the^J^*^ ^ reproduce and disseminate the identified document please CHECK ONE 



of the following three options and sign at the bottom 



an (ample Mckar WnMi below wR bs 
WRxad tod Laval Idoeumanii 


Tto nmpto itlcfcBr awwn tolaw wffl 

sfRxedtoal|jO¥ol2AdocunMriti 


Tto aampla Itlcfcar ahcren Mow 
aflbod to all Laval docunMnis 


1 

PERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL HAS 

been granted by 




HERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL IN 
MICROFICHE, AND IN ELECTRONIC MEDIA 
FOR ERIC COLLECTION SUBSCRIBERS ONLY 
HAS BEEN GRANTED BY 




PERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL IN 
MICROFICHE ONLY HAS BEEN GRANTED BY 










A® 


c^r 










TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 




TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 




- ^ 

TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 


1 




2A 




2B 


Lavall 

f 


Laval 2A 
1 




Laval 2B 
□ 




□ 


CIWGk hm to- UmI 1 fQieaso, parniKH^ 
wproteaonanJiSggBmlnaionininlcroftdww 
EfUC areliM mtdta (sia., itootreni^ and ptow 

copy. 


CtwGfc hare to LmI 2A raloiic, ponnttlng 
reprediKttonanJilhiawInieonininicwilchaandte 
ctoctonfe madia to ERIC archM cofloctton 
tubaortareonly 


Chock here to Laval 2Brela8M, permitting 
raprodudfan and rfigiomlnation fci mtooeclio cniy 






Sign 

here,-* 

please 

O 

ERIC 



tfMiBlvffBi^toiheEduc^kmalfiesourBasIrilbnnaSon Cantor (ERIC) nonext 

^ mfarelfche or efecinfjfc m 


penntestoi to mprodMX# and (tfssem/^^ 

®dw ty persons other than ERIC empkiyees and its system 
t non-profit rsproducdori bylibrarieaaridothersefviceagericies 


eomr^nqu^ Exaapdontsmadelb 

to satisfy Infofnrnbonneefte Of educators ki response to <SacmtBt^^ 




ftlcVyCif^ \Jcn* Fr K , AssiiLA 


X y HOC> ^oiW v 4 l< U 




FAX: 







(oym) 




Ckarliniglhioese om AssessmemU; smd EvaleaMom 



University of Maryland 
1129 Sh river Laboratory 
College Park, MD 20742-5701 



March 2000 
Dear AERA Presenter, 

Congratulations on being a presenter at AERA. The ERIC Clearinghouse on Assessment and 
Evaluation would like you to contribute to ERIC by providing us with a written copy of your 
presentation. Submitting your paper to ERIC ensures a wider audience by making it available to 
members of the education community who could not attend your session or this year's conference. 

Abstracts of papers accepted by ERIC appear in Resources in Education (RIE) and are announced to over 
5,000 organizations. The inclusion of your work makes it readily available to other researchers, provides a 
permanent archive, and enhances the quality of RIE. Abstracts of your contribution will be accessible 
through the printed, electronic, and internet versions of RIE. The paper will be available full-text, on 
demand through the ERIC Document Reproduction Service and through the microfiche collections 
housed at libraries around the world. 

We are gathering all the papers from the AERA Conference. We will route your paper to the 
appropriate clearinghouse and you will be notified if your paper meets ERIC's criteria. Documents 
are reviewed for contribution to education, timeliness, relevance, methodology, effectiveness of 
presentation, and reproduction quality. You can track our processing of your paper at 

http://ericae.net. 

To disseminate your work through ERIC, you need to sign the reproduction release form on the 
back of this letter and include it with two copies of your paper. You can drop of the copies of 
your paper and reproduction release form at the ERIC booth (223) or mail to our attention at the 
address below. If you have not submitted your 1999 Conference paper please send today or 
drop it off at the booth with a Reproduction Release Form. Please feel free to copy the form 
for future or additional submissions. 

Mail to: AERA 2000/ERIC Acquisitions 

The University of Maryland 
1 129 Shriver Lab 
College Park, MD 20742 



Sincerely, 




Lawrence M. Rudner, Ph.D. 
Director, ERIC/AE 



Tel: (800) 464-3742 
(301) 405-7449 
FAX: (301) 405-8134 
ericae@encae, net 
http'J/ericae, net 




ERIC/AE is a project of the Department of Measurement, Statistics and Evaluation 
at the College of Education, University of Maryland. 



